It can't 'learn' on its own. Models only get better with mountains of RnD for data, training, and lots of fine tuning.

So the moment investment dries up, models stop improving.

However, it's likely we'll get good 80/20 solutions where you get most of the performance of the then-unsustainable high end models for significantly less compute.