logoalt Hacker News

Weryjtoday at 7:41 AM1 replyview on HN

Wasn’t quite right before, but Optane was sold off, so it’s sad the buyer just sat on the IP.

Also the selling point was latency, but I suspect we’ll see bandwidth being the important metric with AI using deep pipelines to stream in the weights in a latency insensitive manner.


Replies

PunchyHamstertoday at 11:56 AM

Optane latency was low enough that it could be drop-in RAM replacement for models. Bandwidth is just "stack more of them"