logoalt Hacker News

serf • today at 8:10 PM • 0 replies • view on HN

it's easy to suspect the hosting companies trying to do what they can to reduce cost-to-host up until the very threshold of perceptibility, so it's an easy guess to say they're probably doing something that shifts performance up or down between version releases..

but realistically I think you're right, it's prompt quality and the inherent non-determinism elements of LLMs showing up; when both of those things meet you get brain dead outputs.

Everyone likes to shout "slot machines! non-determinism!" until it actually explains something, heh.