I agree, I never found changing diapers that difficult or bad. I was also hardened by years of chronic insomnia so the sleep disruption wasn't a big deal, I took most of the night-time duties to let mom sleep.
The thing I remember being most annoyed about was cleaning all the bottles. That was really obnoxious.