logoalt Hacker News

codybontecoutoday at 3:21 PM1 replyview on HN

Do all of these models, regardless of parameters, support tool use and structured output?


Replies

Y_Ytoday at 3:36 PM

In principle any model can do these. Tool use is just detecting something like "I should run a db query for pattern X" and structured output is even easier, just reject output tokens that don't match the grammar. The only question is how well they're trained, and how well your inference environment takes advantage.