alt Hacker NewsCurrent RAM is no moat. Upcoming Compute-in-RAM is. And nobody has that built up at scale yet. So, while a moat might become possible, we only have yesteryear's hardware as "moat".
Current RAM is no moat. Upcoming Compute-in-RAM is. And nobody has that built up at scale yet. So, while a moat might become possible, we only have yesteryear's hardware as "moat".
Can you explain what compute in RAM means?
I thought HBMs are technically the fastest possible thing for inference.