logoalt Hacker News

origini • today at 1:40 PM • 1 reply • view on HN

1) RSI:

Give claude a task + compute and see how long it plays around finding a better solution. Doing experiments by itself, profiling, testing, etc. This is impressive and works locally already. More compute you give it, the more interesting things it does.

Of course everything right now is highly speculative but this doesn't mean its not possible. With the current progress, its something highly speculative and plausable which means you should take it serious enough. Doesn't mean you have to go to Datacenters and blow them up.

2) weird argument the author makes. 1 Million experts can for sure achieve a lot more a lot faster than 1. But they are also scaling models in parameter which is not just faster but also potentially more intelligent. If they have more compute and compute gets better faster and cheaper, than bigger models are also more plausable.

3) It doesn't even matter if its going rough because it takes over the world or just because of learning as long as the risk is real that it stumble upon some network which has access to another private network which has access to some launch control pc or starts to mimick a world leader and manipulates humans and you find out, 100 years later, that the biggest disruption of modern society was a LLM agent simulating a book and 'simulating' some book ideas. Our IT infrastructure is fragile when you are able to react a lot faster and better than a human. Our banking system are computers, payment is digital, even plenty of power stations and water stations are controlled digitally remote.

The flaws in these discussions are people downplaying all of it by either not understanding time or the current capabilities of basic LLMs. We are at the beginning of all of it, we are still 'just' using transformer architecture. The LLM progress is still so fast, that everything else doesn't get the attention it might deserve. The LLM is currently in a very fast and deep local minimum and we have no idea whats around.

4 years ago loked very different in LLM and ML capabilites. People were laughing about the danger of an LLM now we have more critical CVEs since ever.

We reached a point were it is cheaper to pay 1000 people to teach an LLM one thing instead of teaching 1000 people or more. It was a skill to be able to use Blender, now an LLM can use Blender. People on Fiverr probably getting a lot less jobs. Real media people are getting fired, translator, writers, etc.


Replies

astro1234 • today at 2:33 PM

> Of course everything right now is highly speculative but this doesn't mean its not possible.

I don't even think this is true either. A year or so ago lab leadership was worried about how they were going to keep progress going when they knew they needed a paradigm shift to handle things like continual learning or breakthroughs on training efficiency. To the point where they invested valuable resources in this bet.

It turns out, this was actually somewhat counterproductive. It turns out that while it may not be the best or most efficient solution, the current paradigm is clearly enough to close the gap to super intelligence.

No one seriously paying attention to performance trends and what's happening at frontier labs that I'm aware of thinks that RSI is more than a year away.

What that will actually look like and the societal implications are more speculative than the actual model capabilities.