Sound let you monitor progress and success/failure. It also provided some security against a program phoning home on its own (as long as the speaker was on).
Once I dialed the number of my grandma with my modem and my uncle answered the phone. So it also guards for when you inserted the wrong number and some person is actually on the line, and not a computer
And not just binary success or failure - you also got to know the handshake sound and could predict if it was successfully connecting at high speeds or not - and so quickly hang up and try again if it was going to be slow.