I put a blob of putty in the speaker hole on my first 'hard' modem for this exact reason