> pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai.

This feels like a very, very weak prediction (though certainly possible).