It seems we could use a new kind of memory that streams the weight data in, like GDDR in reverse.
High Bandwidth Flash? https://www.sandisk.com/company/newsroom/blogs/2025/scaling-...
yes! I guess future hardware designs will have something like that!
High Bandwidth Flash? https://www.sandisk.com/company/newsroom/blogs/2025/scaling-...