I intentionally didn't say AI but LLM because for me the word 'intelligence' is misleading. But LLMs are definitely a leap forward in NLP and what other word for 'comprehension' would you use?

This is a very strong, explicit statement in response to someone using the term rather casually. Can you explain why you are so sure?

I do think you need to define 'comprehension' in order to be certain. A statement fitting the form of "it doesn't comprehend, it just X" is incomplete, because it fails to explain why X is not a valid instance of comprehension.