alt Hacker NewsI don't believe you. Unless you stretch the definition of 'frontier models' or had a prompt that's literally asking for that.
I use LLMs a lot, and since ~GPT-2 times LLMs are not doing anything as broken as `repeating the word "the" until it fills up the context`.
Replies
chuckadams • today at 2:50 PM
It's really uncommon now, but it's still possible. I hit it two days ago with deepseek 4.1 flash, and I've had coworkers report that happening with Gemini.
verdverm • today at 1:51 PM
quants still do this and the token vendors serve those up when demand is greater than supply
things have definitely improved significantly, however "never say never" is still good advice
I believe them. I had Gemini-3.1 Pro do essentially this seven months ago - specifically a loop of writing "Bye! Done!" repeatedly until manually stopped. Presumably some sort of pathological behaviour where it wasn't ranking the stop token highly when it should have been... but damned if I know why... it was an innocent prompt (and it had done the thing I asked it to before failing to stop).