alt Hacker NewsThat's their point, we can't assume model capabilities will go up linearly forever just because they have increased quickly in the past
That's their point, we can't assume model capabilities will go up linearly forever just because they have increased quickly in the past
"We're running out of data, so LLM progress is hitting a wall" was a prominent late-2024 narrative. Back then many experts including Ilya used the word "plateau" when describing LLM progress. No one is using that word now, and there is no evidence we are about to reach a plateau, even though we ran out of data long ago.