logoalt Hacker News

mgraczyklast Wednesday at 5:21 PM1 replyview on HN

LLMs, considered as a function of input and output, are not immutable at runtime. They create tokens that change the function when it is called again. That breaks most theoretical arguments


Replies

anonymoushnlast Wednesday at 6:20 PM

Sure. Another view is that an LLM is an immutable function from document-prefixes to next-token distributions.

show 1 reply