No, unified memory is not a panacea. The PS5 GPU is mostly raster-focused and doesn't have good acceleration options outside Vulkan compute.

Your best ~$300-400 option for inference is still the RTX 3060 AFAIK.