Size is the tough part. These models require 256GB+ of vram, but other then that I think it's possible!
Transcription models certainly don't require that ram. Parakeet even runs the CPU while generally outperforming Whisper.
Transcription models certainly don't require that ram. Parakeet even runs the CPU while generally outperforming Whisper.