logoalt Hacker News

OutOfHeretoday at 1:37 AM2 repliesview on HN

Five years from now, I don't know why anyone will still be using Nvidia for inference. Note that Cerebras is for inference only, not for training.

I understand that Cerebras has competition, but this bodes even more poorly for Nvidia for inference. Nvidia may still have a role to play for training, however.


Replies

kcbtoday at 4:06 AM

Nvidia is at this time a pretty well run company tech wise. They are going to keep iterating on the inferencing hardware stack over the next five years too.

wmftoday at 1:48 AM

Cerebras is only claiming ~2x the performance of Groqvidia which usually isn't enough for people to switch.