logoalt Hacker News

bigyabaiyesterday at 3:38 PM2 repliesview on HN

taps the sign

  Unified Memory Is A Marketing Gimmeck. Industrial-Scale Inference Servers Do Not Use It.

Replies

rcxdudeyesterday at 11:48 PM

Unified Memory is mainly how consumer hardware has enough RAM accessible by the GPU to run larger models, because otherwise the market segmentation jacks up the price substantially.

show 1 reply
zozbot234yesterday at 3:42 PM

Industrial Scale Inference is moving towards LPDDR memory (alongside HBM), which is essentially what "Unified Memory" is.

show 2 replies