Assuming high bandwidth flash works out, RAM requirements should be drastically reduced as you'd keep the weights in much higher capacity flash.
> Sample HBF modules are expected in the second half of 2026, with the first AI inference hardware integrating the tech anticipated in early 2027.
https://www.tomshardware.com/tech-industry/sandisk-and-sk-hy...
How does HBF compare to the discontinued 3D XPoint?