logoalt Hacker News

DylanMerigaudtoday at 5:38 PM1 replyview on HN

8-29MB models for structured JSON output are compact yet functional.


Replies

HenryNdubuakutoday at 5:46 PM

Yes, it was really difficult to compress meaningfully intelligence down to that, and there are many limitations we are aware off and still improving on.