If these benchmarks can hold up in real life, we are seeing again and again an intelligence explosion in front of our eyes and devaluation of intelligence.
Anyone has more background how they were able to catch up that fast? Distillation of GPT due to their OpenAI acess to the model might make most sense but they probably are not allowed to do that.
TBH, DeepSWE 1.1 has been busted for a while (is anyone out there arguing Gemini 3.8 Flash is as good as Astra lol?), and TB2.1 as a top line when they are currently at 4 (which is substantially harder) and FrontierCode at 1.1 when it's currently at 2.0 does not bring a lot of confidence.
Of course I always want to see more competition in this space, though!
"intelligence explosion"
Are you a real person? Who talks like this?
It seems they trained from scratch: https://microsoft.ai/news/frontier-pre-training-at-microsoft...