What quantization level is that? Because official endpoints are slow.
V4 Flash fits entirely in two RTX Pro 6000s without any quantization at all.
From opencode go $10/mo plan I get between 60 t/s and 100 token/s even with large contexts of 150k+ tokens.
I wouldn't call 80 t/s slow.
It doesn't need extra quantization. The official weights are natively mixed precision FP4/FP8, so it fits in ~160GB. The API slowness is probably from being batched with other concurrent user requests. The provider's aggregate throughput gets higher but per-stream speed slows down.