Is this for setup for agentic coding? Why not also run the IDE compiler etc... on the same machine to use those CPU cores as well?
You can, you just need a beefier PC, and it's more annoying in terms of noise and heat vs throwing something on your server closet. Plus you don't need to worry about other software stealing resources and whatnot.
Keep in mind that if you want MTP it adds a few gigs. If you use sub-agents it turns already slow generation into even slower generation. Won't be doing any compling (so rust, c and probably go are not avaiable) becase those add memory pressure during compiling.
32gb of unified memory is enough enough for system to be used for anything other than LLM generation.