logoalt Hacker News

nananana9yesterday at 5:05 PM2 repliesview on HN

The same way we've always done it - glance at it and see if the numbers look like they're within an order of magnitude of what looks reasonable.


Replies

tremonyesterday at 5:57 PM

So as long as the LLM only makes errors in the single-digit percentage range, everything is peachy. Make number go up, but not by too much.

show 1 reply
fl4regunyesterday at 6:36 PM

so what if there were some numbers in the report which are in actuality, an order of magnitude or two outside of what you think is reasonable, because something was wrong, but the AI agent reports something that looks normal?