This is awesome. I really want to get something like this integrated directly into my agent IDE (https://getness.dev).
The main thing I need is some way of auto-sending a "end of message" button (like a newline would do) at the end of the message so that it auto-sends the chat.
Not sure the exact right way to implement that, but it seems like something that could be general purpose. Maybe a setting per-active app?
Many people are using Nemotron (NVIDIA provides Linux binaries for ARM and Intel that you can shove into a server and do audio over websockets for them).
I use handy.computer in push-to-talk mode. It inserts text in the active text box when you let go. It also supports auto-submitting at the end, so maybe that would help? I think it can send new line.