Forgot the most important part of pf.conf!

    # NAT64
    pass in inet6 from any to $nat64_prefix af-to inet from ($ext_if)