Llm's have come on quite a bit beyond the fundamentals nowadays. Attention heads really are a thing.