alt Hacker NewsI didn't see cost. If cost is similar to flash drives then this could be massive. Every GPU ships with a lot of ram still but for AI inference and games you have 10TB of this stuff to stuff all your textures into and all your model weights in. For fine tuning models this would also be great if using lora or similar.
I expect it to be closer to flash than to RAM, but still expensive. It'll require some special NAND flash dies, and "good" dies too.
Although they'll be able to do the usual thing, and "recycle" the bad dies by selling them off to be used in normal flash drives and SD cards.