I recently found this 1.58-bit model for ASR and it's surprising good (and very fast), that being said it's not a LLM.

https://huggingface.co/moondream/parakeet-redux