alt Hacker NewsWould be good to put equivalent grades on LLM's then. Instead of GPT-4o, it's GPT-11th grade.
Replies
1oooqooq • 10/12/2024
that's in the wrong directing of what the comment said
Would be good to put equivalent grades on LLM's then. Instead of GPT-4o, it's GPT-11th grade.
that's in the wrong directing of what the comment said
The problem is that some % of the time they answer at an 11th grade level, and some % of the time they answer at a 4th grade level, with no way of knowing beforehand.
The only way of knowing is after the fact, when the prompter has the knowledge to discern whether the answer is correct or not.
In which case why are we asking questions we already know the answer of, other than these are toys and fun?
I really wonder what happen when the novelty wears off in a few years, where these things are actually useful.