logoalt Hacker News

Dylan16807yesterday at 5:43 AM1 replyview on HN

We don't have a model for how an LLM that doesn't exist will respond to a specific query. That's different from lacking insight at all. For an LLM that exists it's still hard to interpret but it's very clear what is actually happening. That's better than you often get with quantum physics when there's a bunch of particles and you can't even get a good answer for the math.

And even for potential LLMs, there are some pretty good extrapolations for overall answer quality based on the amount of data and the amount of training.


Replies

famouswafflesyesterday at 1:23 PM

>We don't have a model for how an LLM that doesn't exist will respond to a specific query.

We don't have a model for a LLM that does exist will respond to a specific query either.

>For an LLM that exists it's still hard to interpret but it's very clear what is actually happening.

No, it's not and I'm getting tired of explaining this. If you think it is, write your paper and get very rich.

>That's better than you often get with quantum physics when there's a bunch of particles and you can't even get a good answer for the math.

You clearly don't understand any of this.

>And even for potential LLMs, there are some pretty good extrapolations for overall answer quality based on the amount of data and the amount of training.

Oh really ? Lol

show 1 reply