alt Hacker NewsI’m not sure I understand the hype around this model. Isn’t this just an llm with a chat template, with the options prefix cached?
<option>option A</option> <option>option B</option><endofoptions>userprompt<eos>
To get calibrated probabilities sounds like a very good feature, if they are indeed well calibrated.
And in my experiments even Qwen 3.8 has a hard time to consistenly conform to a schema, requiring retries, JSON cleanup etc, so to have a model of similar quality (SemIf et al) that simply cannot deviate from the schema by construction could be very helpful.
But I still need to experiment with either Jev/SemIf myself.