logoalt Hacker News

nfw2last Tuesday at 12:16 AM1 replyview on HN

A request that isn't asking for information isn't a query


Replies

16bitvoidlast Tuesday at 1:12 AM

That's just what some people generally use to refer to LLM input string/prompt/message/etc. The only thing the LLM can do is return information...in the form of text, so every request is one for information.

If we want to get really pedantic, every generated token is the answer to the query: what's the next most probable token in this sequence of tokens?

show 1 reply