I’ve actually tried before to self host on my VPS as well as my homelab that I use for various services. I honestly just didn’t trust the stability of my own services enough for something as important as email. As a project I definitely want to try again in the future.
Email is ridiculously resilient to downtime. Exam, for example, will retry by default for several days before giving up on delivering a message.
Even if you don't actively monitor your server and only notice there's a problem after three days of not getting any mail, odds are you'll still receive most of them after fixing the issue.