logoalt Hacker News

rohansood15 • today at 11:47 AM • 1 reply • view on HN

Jev is cool, but this example is really bad.

The example flags a '10 tablets' dose as a possible erroneous extraction, when the text says exactly that. So it is a false positive.

Furthermore, even if your goal was to catch logical errors rather than extraction errors, you are better off using programmatic checks on the extracted value and having a dedicated error handling path including additional full LLM calls, rather than decision model.


Replies

LewisDwyer • today at 12:00 PM

The idea is that Unsiloed would check for values that are hard to read and Jev checks for semantic issues. No one is prescribing 10 tablets, 3 times a day. In this example it's Jev's job to check for obvious errors in units and so it flags this value. Unsiloed cannot flag it because, as you said, the text says exactly that. That's why the models work well together as they catch different issues.

➕ show 1 reply