Why would anyone want to run an LLM on Apple's hardware? Why not buy an NVIDIA GPU?
Try to find a NVIDIA GPU with 256/512 GB of RAM.
Try to find a NVIDIA GPU with 256/512 GB of RAM.