logoalt Hacker News

avidphantasmlast Monday at 11:19 PM1 replyview on HN

The AI labs are racing to create a moat out of trillion-parameter models and the GPUs that can run them. The problem is this is the wrong architecture for most AI inference use cases. On-device inference is where this is going, clearly Apple believes this too. So Zitron is entirely correct about this AI datacenter build out being a boondoggle with no ROI.


Replies

vineyardmikelast Tuesday at 12:07 AM

[dead]