logoalt Hacker News

vzalivayesterday at 5:30 PM2 repliesview on HN

Is it something wihch would make PS5 attractive to run local LLM models? I've heard Mac Mini shared CPU/GPU memory makes it popular for that.


Replies

pantalaimonyesterday at 10:27 PM

The Mac studio also comes with up to 512GiB RAM.

The PS5 only has 8GiB.

show 1 reply
bigyabaiyesterday at 5:34 PM

No, unified memory is not a panacea. The PS5 GPU is mostly raster-focused and doesn't have good acceleration options outside Vulkan compute.

Your best ~$300-400 option for inference is still the RTX 3060 AFAIK.