They were given day zero access to release their quantizations[0]. The lowest quant will still require 256GB VRAM to run inferences, but as always I'm amazed by the Unsloth team by how much they can reduce the requirements for these powerful LLM's, and the easy-to-follow guides to get started with using them.

[0] https://unsloth.ai/docs/models/mistral-large-4

https://huggingface.co/unsloth/Mistral-Large-4-1T-A52B-GGUF

I have no idea how you could shrink this down to fit on any type of prosumer hardware though. I doubt it's possible.