logoalt Hacker News

scoopdewoopyesterday at 5:51 PM2 repliesview on HN

Not quite. They have 128GB of ram that can be allocated in the BIOS, up to 96GB to the GPU.


Replies

cpburns2009yesterday at 10:30 PM

You don't have to statically allocate the VRAM in the BIOS. It can be dynamically allocated. Jeff Geerling found you can reliably use up to 108 GB [1].

[1]: https://www.jeffgeerling.com/blog/2025/increasing-vram-alloc...

khimarosyesterday at 6:51 PM

allocation is irrelevant. as an owner of one of these you can absolutely use the full 128GB (minus OS overhead) for inference workloads

show 1 reply