Why not actually use smtp+imap/pop3 if that is the intention?

Also I'm going to complain a little bit about the name: SMTP is for sending (not reading) mail, so asmtp to me at first glance looked like 'async-smtp' which didn't really make sense. And 'agent-smtp' sounds like "let your agents send e-mail" vs an api spec.