My understanding is that these "preview" models are usually earlier RL checkpoints, and that "official release" happens when they're happy with the training run?

I believe they mentioned around the preview announcement that they'd be releasing improvements to capability, which I assume means continued training.