I would love to stop paying AWS for public ipv4 addresses.

But simply it is impossible to go full ipv6, as many of isps of the clients do not support it.

Currently there is no pressure to the isps to move to ipv6. In fact the incentives are OPPOSITE! They love charging for static IPs.