logoalt Hacker News

TeMPOraLyesterday at 5:42 PM1 replyview on HN

It does make some sense given they're positioning it as alternative to the normal way you'd implement such output shape, which is to slap a prompt on a frontier LLM and maybe run it in "constrained output" mode if you like things fancy. Against that use case, the "no hallucinations" and parallelism and cost claims all sound legitimate and useful -- and similarly, "but we could do that with BERT two years ago" does not.


Replies

seizethecheeseyesterday at 8:06 PM

I mean, the constrained output mode also doesn’t hallucinate in this sense.