All the curves have been levelling off as expected. Not really sure what you're talking about.
They have not, every successful pre-train as of late has had performance increases greater than what the scaling laws predict.
alt Hacker News
They have not, every successful pre-train as of late has had performance increases greater than what the scaling laws predict.