What's interesting and annoying is that the results only matter for these specific releases of the models, with the specific parameters used.

That isn't obvious, unless you've been doing ML for a while.