> I sort of see the connection between machine learning and LLMs but it doesn't seem too obvious to me.

Why isn't it obvious? Transformers are deep learning models, and deep learning is a subset of ML.