alt Hacker NewsJust added this to my benchmark site: https://multilingualsttbench.com/
It doesn't reach the frontier in either latency or accuracy for ai multilingual conversations.
Replies
Kokouane • today at 3:07 AM
I'm confused, doesn't your leaderboard clearly show it is the most accurate model? It's number one in the leaderboard. Am I missing something?
➕ show 1 reply
Thanks for this, really helpful.
I would also like to see benchmark for translation. I'm looking for live translated subtitles so my Japanese wife can enjoy any show with out waiting months for official VOD streams to release them.