alt Hacker NewsI'm hoping AMD wins when the RAM bubble bursts and their integrated AMD 395+ platform can keep getting faster and higher bandwidth.
Replies
speed_spread • yesterday at 7:06 PM
The unified memory architecture is interesting for toying with medium size models but will never offer as much bandwidth as a dedicated GDDR memory bank. Conversely, GDDR can't be used for general CPU purposes because access latency is just too high. Unless someones also comes up with dynamically programmable memory banks, something I'm not sure would even be possible.
Forget the 395+, I want the MI350P (or similar) long term.
PCIe card is the way forward IMO, AI keeps changing so you don't want static hardware.