This is all lovely and I wish them the best.

But please don't use ollama, or their quants. Not only is the app itself slower than pure llamacpp. But their quants are often no where near the best.

I really hope people start with something like unsloth, as their software and quants are really much better all around.