alt Hacker NewsWe were messing around at work last week building an AI agent that was supposed to only respond with JSON data. GPT and Sonnet more or less what we wanted, but Gemma insisted on giving us a Python code snippet.
Replies
cubefox • today at 3:36 PM
Gemma≠Gemini
> that was supposed to only respond with JSON data.
You need to constrain token sampling with grammars if you actually want to do this.