> You can just spin up a raw VPS on EC2 or Lightsail, give it a public IP, and call it a day

You could do this, but for the life of me I can't imagine why you do this over using a platform like DO, vultr, hetzner or any one of a hundred similar services that will give you a better developer experience for this kind of workflow, often at a fraction of the price