alt Hacker NewsI was thinking this, too. Here's an even crazier thought: don't even make it rack mount. Make it NUC-sized. Two PB&Js stacked on top of each other, that's the form factor. EC2 except it lives under the couch.
I was thinking this, too. Here's an even crazier thought: don't even make it rack mount. Make it NUC-sized. Two PB&Js stacked on top of each other, that's the form factor. EC2 except it lives under the couch.
Their engineered power and cooling solutions are all for rack-scaled hardware, doing a NUC wouldn't make sense. Now a silent and efficiently cooled studio-sized rack with enough hardware (including AMD GPUs) for reasonably quick AI inference with the latest local models, that's something that they could do and be quite popular.