"If all you have is an LLM, every problem looks like summarizing information."

Emphasis on looks like ;-)