Jev introduces a new shape of LLM

I thought this wasn't really an LLM sure text as input but the folks at Typesafe have been very adamant this is a new class of model not just another LLM.

Although to be fair we don't know enough about the architecture.

I’m not sure I understand the hype around this model. Isn’t this just an llm with a chat template, with the options prefix cached?

  <option>option A</option> <option>option B</option><endofoptions>userprompt<eos>

This is off topic.

Do people not feel like LLM speak (Claudisms) is infecting their own diction? Saying 'a new "shape" of LLM' sits so very poorly.

About jev being a black box and the potential for bias, I think it boils down to what questions you are asking the model.

Broad questions like Is this resume good / score this city will ofcourse be biased but I think jev encourages more granular focused questions like Score this candidates Python experience / Rate this city for its food which then allows you to introduce your own biases in which questions you ask and how you combine their answers.

In this way I think jev like models can be easier to reason about for critical decisions.

I think "Black boxes are back in fashion" is missing the point. I think LLMs are still largely black boxes, and I don't think chain of thought is representative of any degree of inner machination. Asking it questions to justify itself is at best a facsimile, and for the most part it's useful, but it's fundamentally a facsimile.

Where I understand Jev to be a significant jump is that afaik the confidence scoring is actually derived from the normalised probabilities, and not a continuation in a chain of prediction masquerading as "confidence."

Is it 100% deterministic?