DDR5 is a couple of orders of magnitude slower than really good vram. That’s one big reason.

Would that be worth anything, though? What about the overhead of clock cycles needed for loading from and storing to RAM? Might not amount to a net benefit for performance, and it could also potentially complicate heat management I bet.

A single CAMM might suit better.