Others have mentioned the general pricing, simplicity etc.
Outbound data pricing is a potentially huge saving.
AWS is as much as $90/TB outbound with 1GB free. Hetzner is $1.20/TB (in EU and US) with 1TB/20TB (US/EU) free.
(Good) Smaller places are more likely to have actual technical staff you can talk to.
I have a dedicated server at one provider with $0.30/TB overage, and it's that cheapest I've ever seen. This provider appears to optimize for bandwidth–heavy use, advertising their connectivity heavily.