logoalt Hacker News

FuriouslyAdrifttoday at 7:27 PM0 repliesview on HN

Yes. We have a quad MI300A server and run several inference models on it. For $107k it has saved us so much money on tokens already and it's a heck of a lot faster than cloud services.