I think we're going to suddenly see them greatly scale back training and try to sell inference-only, but they all know when they do that someone can jump up and outstrip them.
> I think we're going to suddenly see them greatly scale back training and try to sell inference-only
Remember a few weeks ago when all the AI labs said "we need to slow down, to uh, prevent destroying the world"?
But only as long as training actually improves models significantly. As soon as those improvements stay below a certain threshold, the better move is to invest your R&D money into other things like harnesses or new tricks one can play with existing models and the immense cost of training is just not worth it to be 0.5% ahead.
I'm absolutely certain that we will reach that point, just not when. Could come sooner than we think though.