This is all obvious and not news, but there's a lot of people doing fighting retreats against LLM intelligence where the degree of obviousness matters.
Anticipatory token selection was obvious when you used structured output on gpt 3.5.
The model would construct/hallucinate pre-conditions to satisfy some final output value that the model was predisposed to.
Anticipatory token selection was obvious when you used structured output on gpt 3.5.
The model would construct/hallucinate pre-conditions to satisfy some final output value that the model was predisposed to.