alt Hacker NewsLLMs today are improved by experiments that assay their performance, changes to architecture, pretraining, and post-training. None of those steps necessarily require humans. Welcome to your sci fi future.
LLMs today are improved by experiments that assay their performance, changes to architecture, pretraining, and post-training. None of those steps necessarily require humans. Welcome to your sci fi future.
The implicit understanding of recursive improvement is that there is some step change increase in capability that only a superior intelligence will be able to achieve.
A model being able to train a bigger model with marginally better capabilities is not what the hype was about.