alt Hacker NewsThe proof is that LLMs could barely solve arithmetic 3 years ago, but now surpass the best human mathematicians, and that this has all occurred from simple principles (RL + compute) that will continue to scale up by factors of millions in the coming years.
Also, advocating for slowing LLM progress does not benefit Anthropic or OpenAI.
Replies
xyzsparetimexyz • today at 1:51 AM
It won't scale up by factors of millions, that's just obscene hyperbole. Since chatgpt we've probably made things 10x more intelligent on the same hardware. We've also made way more expensive models. Maybe we get a maximum of another 10x efficiency and 5x model size/expense from this point but millions is a joke.
EA-3167 • today at 1:57 AM
Haven't people learned about the peril of assuming, "Line go up" yet?!
TRENDS HAVE FEEDBACK
➕ show 1 reply
They surpass the best human mathematicians in one specific way: they don't get tired or bored.