You can set it up with docker compose and put the container on the same network of your dev env, and you are good to go.

What I'd really like is an image that mirrors extensions available on AWS Aurora. Supabase's is the only that has some parity as far as I know