alt Hacker NewsDo you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
No, but a random person off the street also isn't making skills for LLMs.
I think that LLMs are trained on the millions of vibe written LLM blog posts that are more superstition than fact. There is a lot of snake oil out there that is treated as fact. If someone claims that an LLM is better than humans at something I always want to see the rigorous evaluations that have been done to quantify it, not "but they're trained on everything!"