logoalt Hacker News

Tepixtoday at 4:49 PM1 replyview on HN

Have you thought about getting a second 128GB device? Open weights models are rapidly increasing in size, unfortunately.


Replies

tarrudatoday at 7:11 PM

Considered getting a 512G mac studio, but I don't like Apple devices due to the closed software stack. I would never have gotten this Mac Studio if Strix Halo existed mid 2024.

For now I will just wait for AMD or Intel to release a x86 platform with 256G of unified memory, which would allow me to run larger models and stick to Linux as the inference platform.