> The average human can't solve a millenium problem in mathematics but the LLMs are able to now.
I think comparing the resources they spent at it would be a more apt comparison.
AKA if you tasked 150 mathematics departments to only focus about that problem, and stop doing things like teaching and researching anything else, you might get close to the amount of resources that these companies put into solving the problem to get a press release.
Then you misunderstand the resources they put into it at training.
Read about the entire huggingface attack and why it happened.