Yeah that's kinda my point. I'm not sure if the models have gotten that much smarter, but they're certainly getting more capable. That's not the same thing though.

There are things GPT 6.0 can accomplish for me that 5.3 was not able to. But there are also things it still fails at, and it doesn't seem to be much better at the big picture. It does spam about 100x more tests though and I wonder if just RLHFing it to test everything constantly is carrying it more. 6.0 writes so many tests and spends so much time verifying it's work in python sandboxes. Slow as hell but it tends to get things right the first time more which is good, I guess. I don't love the thought of a 500loc feature adding +4000loc due to tests though.