Their document states they support v6, and given how much of their stack involves v6 I would be shocked if they didn't support v6 outbound.

> Outbound IP addresses

> Fly Machines have IPv6 addresses from which they make requests to the wider internet without going through the Fly Proxy.

https://fly.io/docs/networking/services/