logoalt Hacker News

tveita • today at 8:50 AM • 0 replies • view on HN

> One thing that surprised us was that JSON key order changed the answer. Sending the same content with keys in a different order moved the output probabilities by up to 0.19.

That's like... really basic LLM knowledge? Like how e.g. this article measures how often answers change based on order https://zachlandes.com/trolley-problem/#appendix-a:~:text=Ch...

Or is this the Claudish "One thing that suprised us" that just means "and here's another thing"?