logoalt Hacker News

com2kidtoday at 12:29 AM0 repliesview on HN

AI voice chat can be done for cheap.

Lots of it is RAG and knowledge base lookups, you don't need large fancy models. Indeed you want fast responses, so low parameter models are better.

TTS and ASR models are tiny now days, like a handful of GB tiny.

Last time I priced this all out the VOIP fees cost more than self hosting all the models.