You know what's worse? Talking, and then hearing yourself half a second later.

I worked at a callcenter that had a problem that sometimes that would happen. The pet theory was that meant they were recording the call to audit it.

You end up stuttering because you think the caller is talking and you want to listen to them, but it's just your own voice back.

You do eventually learn to deal with it, but it was always terrible.