logoalt Hacker News

Jtariiyesterday at 9:32 PM4 repliesview on HN

>What's the worst potential outcome, assuming that all models get better, more efficient and more abundant

Complexity steadily rises, unencumbered by the natural limit of human understanding, until technological collapse, either by slow decay or major systems going down with increasing frequency.


Replies

motoxproyesterday at 9:38 PM

why would the systems go down if the models are better at the humans at finding bugs. Playing a bit of devils advocate here, but why would the models be worse at handling the complexity if you assume they will get better and better.

All software has bugs already.

show 2 replies
doug_durhamtoday at 1:41 AM

Existing software is already beyond the limits of human understanding.

simondotauyesterday at 9:57 PM

It’s always been thus at lower layers of abstraction. Only a minority of programmers would understand how to write an operating system. Only a tiny number of people would know how a modern CPU logically works, and fewer still could explain the electrical physics.

show 1 reply
fdsajfkldsfkldsyesterday at 9:38 PM

The Anti-Singlarity! It's coming for us all.