logoalt Hacker News

ofjcihentoday at 5:12 PM2 repliesview on HN

This is akin to “don’t make mistakes”

“Verify all facts and compliance requirements” leaves enormous holes even if you assume the LLM has a concept of facts and requirements (it does not).

What facts? What requirements? For what industry? For what subset of that industry? For what country or countries that you will be doing business in? Are these current “facts” and “requirements” or is the LLM referencing a dusty article from 1992 for which the subject matter has been radically overhauled?

In my job I regularly see small but incredibly important mistakes like this lead to major issues. Some of those are human driven but increasingly the defense of the person responsible has turned into “Claude said it was fine though!”


Replies

kolinkotoday at 6:54 PM

Well, you wouldn't just give human a task "verify all facts and compliance requirements" and expect it to end well either, no?

show 2 replies
ilakshtoday at 5:24 PM

It can make mistakes and will sometimes, but what he specifically mentioned was a case where it did not pull up a reference that it needed. So using a web search tool effectively would make a big difference.

show 1 reply