logoalt Hacker News

namr2000 • today at 6:22 PM • 0 replies • view on HN

There are many big technical question-marks on if RSI is even possible. However, the advances in LLMs that we've seen is definitely not just limited to data and scale.

First: modern LLM architectures are quite far from the GPT-2 era (delta/linear attention, GQA, sparse attention methods, looped transformers, mixture of experts, engrams, etc).

Second: RL environments are largely autonomously generated at this point, as models get smarter they can generate even more complex environments to train in. While this does go into the "data" category, it's not human-generated or even gathered data. This gets particularly spooky when you think about things we cannot yet simulate, that models can develop mathematical methods & simulators for. For example: better/faster physics simulations for robotics RL, better biological simulation environments etc.