Personally I have never had any issues hosting my own email (for myself or for business customers) for the last 25 years.

The only time I've ever come across a big problem with email in general was when one of my customers was using 1and1.com hosted email, who apparently have a bad reputation due to spam, and some providers outright block them... but moving that company to self-hosted email fixed the problem.