> Our work was heavily inspired by KyutaiTTS and Sesame
I wish they’d describe the technical details of the differences between this and other TTS they were “inspired by”.
So many projects like this, I will just have to assume they are vibe-coded clones to get some publicity unless there’s more technical details.
Sesame is an impressive real time conversational audio-to-audio model you can talk to on their website [1]. But it's closed source. They released some components, but nothing you could use to duplicate their work.
Sesame is what this team (and lots of teams) want to build. I know another team trying to build a real time local NSFW girlfriend you can talk to. They're convinced they can reach $100M ARR quickly if they crack it and make it customizable.
KyutaiTTS provides a lot of the ingredients for this work, but it isn't conditioned for audio to audio afaik or any of the streaming components.
This is a streaming version of their previously released Dia TTS, which was an original work. You may want to recalibrate your assumption.