> This page has been in 'New model — collecting baseline data. Degradation detection paused.' state for months now. It seems to never say 'degraded'.

Click the part at the end that says "View historical performance". They wait to collect more data about a new model before adding it to the overall charts.

The overall solution rate continues to climb when new models are considered.

> If you look at the graphs, the latest benchmarks are showing a pretty significant dip, and they match pretty well with some horrible experiences I've had in recent weeks. You can see token usage steadily going down, matching exactly what the author measured on his own.

The y-axis is amplified to make differences look larger than they are.

Hover over the dots to see the confidence interval. A 1-2% change means nothing.