To avoid "AI barging into human conversations unsolicited", you can either stop the AI from barging in, or remove the premise that this is a "human conversation". The latter might be easier.