alt Hacker News>We don't have a model for how an LLM that doesn't exist will respond to a specific query.
We don't have a model for a LLM that does exist will respond to a specific query either.
>For an LLM that exists it's still hard to interpret but it's very clear what is actually happening.
No, it's not and I'm getting tired of explaining this. If you think it is, write your paper and get very rich.
>That's better than you often get with quantum physics when there's a bunch of particles and you can't even get a good answer for the math.
You clearly don't understand any of this.
>And even for potential LLMs, there are some pretty good extrapolations for overall answer quality based on the amount of data and the amount of training.
Oh really ? Lol
> We don't have a model for a LLM that does exist will respond to a specific query either.
Yes we do... It's math, you can calculate it.
> No, it's not and I'm getting tired of explaining this. If you think it is, write your paper and get very rich.
Why would I get rich for explaining how to do math?
> You clearly don't understand any of this.
Could you be more specific?
Quantum physics is stupidly hard to calculate when you approach realistic situations.
A real LLM takes a GPU a fraction of a second.
They're both hard to interpret, please realize I'm agreeing that LLMs are hard to interpret. But they're easier than QM on some other fronts.
And mentioning copenhagen or many-worlds doesn't show that quantum mechanics are easy to interpret, that's about as useful as saying an LLM works like neuron activation.
> Oh really ? Lol
Here's one of many posts about it. https://cameronrwolfe.substack.com/p/llm-scaling-laws