logoalt Hacker News

adamddev1today at 11:48 AM2 repliesview on HN

I love having auto-generated subtitles available, but I am still skeptical that we can call them "accurate" yet. For many languages the models are quite weak, and even for English and German on YouTube I see errors all the time.


Replies

lucideertoday at 12:07 PM

Even for English (which surely has the best support) anything outside of urban American accents is still incredibly weak - you can pretty much guarantee very noticeable mistakes on even highly intelligible mainstream urban British/Irish/Aussie/Kiwi/SA accents. Stronger regional / rural accents & dialects usually render generated subtitles entirely useless.

Definitely a domain a million miles from being solved if even English is this bad.

IbrahimF96today at 11:52 AM

Yeah I agree the Youtube ones are not very good, I am not sure what they have implemented behind the scenes for it. However this uses the Whisper Large model which is quite a bit better than the Youtube auto generated ones. Only catch is you need to have the video on disk and wait a bit longer lol

show 1 reply