logoalt Hacker News

ofjcihenyesterday at 8:33 PM1 replyview on HN

If I grep a file over and over again it’ll be long time before the universe affects the components enough to result in a different output.

If I ask an LLM to do the same thing twice it will do it differently.

Arguments are arguments but unless grounded in some kind of practical sense then they aren’t really useful and are more akin to something like “YOUR MOMS A STOCHASTIC PARROT!”


Replies

pixl97yesterday at 8:52 PM

Then please start grounding your arguments in some practical sense!

>If I grep a file over and over again it’ll be long time before the universe affects the components enough to result in a different output.

Or a ram flip will effect it 30 seconds later, but I get the gist of you're describing a non-determistic process.

>If I ask an LLM to do the same thing twice it will do it differently.

If I ask a human to do the same thing twice there are a few possibilities. 1. they copy their old work and present it as their new work. 2. The process is very simple and follows a few basic steps with high repeatability. 3. They'll have learned from their other attempt and do it in a more optimized fashion. 4. They will have forgotten how they did it exactly and reproduce something that looks somewhat like what they created the first time.

Also, LLMs run with a temperature to help avoiding minima/maxima of supplying the exact same answer, this can be reduced to 0 and that makes any one response to a fixed prompt similar if not the same. When you get into agentic tasks with their own history it develops it's own "flavor" of doing things.