> * Changing the choice order changes the probabilities! Moving the red marble from first to last choice changed its probability estimate from 86% to 73%

These models seem to have the same biases and limitations of LLMs minus speed. Outputs and inputs should be treated the same way as LLM prompts.