logoalt Hacker News

mike_hearntoday at 10:31 AM0 repliesview on HN

It's possible but it's not linear. A modern AI training cluster is a supercomputer that uses very different architectures and hardware to a bunch of small PCs connected via normal networking. The networking advantage alone kills any chance of decentralized training.