alt Hacker NewsIt seems strange though.
Did they find this improvement within the week? If so, given all their whinging about safety, it seems irresponsible to only test the improved model for less than a week.
Did they find the improvement more than a week ago? If so, why bother releasing GPT 6 if they knew they had a better version essentially ready to go?
Pipelining.
They probably have 6.2 just about ready, while 7 and 8 are still being cooked up. You can work on multiple releases in parallel.
We're just getting the latest training checkpoints constantly, just to edge out the other lab, while they are trying to come up with something worthy of a new major version number. It's actually worrying, since there's so much pressure to release now.