There were some models in the past [1] that were extremely keen to produce chatty noise, even when you explicitly asked them not to.

Of course this was back in May 2023, so things might have improved since then.

[1] https://news.ycombinator.com/item?id=35964018