alt Hacker NewsI'd be careful sending raw audio to public APIs given the sensitive commercial info. A local pipeline with Whisper and Llama 3 is viable now and solves the privacy issue. It also keeps the long-term inference costs much lower.
I'd be careful sending raw audio to public APIs given the sensitive commercial info. A local pipeline with Whisper and Llama 3 is viable now and solves the privacy issue. It also keeps the long-term inference costs much lower.
Llama 3 is far from cutting edge now and the value from quality analytics would far surpass risk adjusted odds of your info leaking.