alt Hacker NewsHow is it different than just asking an LLM with structured outputs enabled? Is the primary value-add that it gives a confidence level?
Replies
pegasus • yesterday at 9:33 AM
Mostly, they are much faster and cheaper.
blarelewis741 • yesterday at 1:33 PM
[flagged]
1) you can parallelize the request 2) since a structured output is still just text then every previous property of the structured output effects subsequent ones