alt Hacker NewsCheck out Krasis https://github.com/brontoguana/krasis
It enables something similar to unified memory. Ive got a 5060 (16GB) card and 96 GB ddr5.
I can run qwen3.5-122b int4 at 25tok/sec.And now even does image ingestion!
Ive been bulk transliterating and translating foreign language books into english. And all completely local.
Wait so this makes it so I can use my DDR5 as well as my VRAM combined? This is actually sick if so. Maybe I will actually have to go out and buy some more DDR5 (currently only have 32GB...)