You will spend thousands of dollars on hardware to run those at lower quality (quantized) than the benchmarks where they match March SOTA performance.

Source: I have the hardware to run those locally. I would never recommend it to anyone trying to save money. It’s so much cheaper to pay even Anthropic or OpenAI.