You just don't ratify it, simple. The US does not ratify treaties all the time, especially now.
Coming under the French nuclear umbrella explicitly means that if a country is under extreme threat of nuclear attack, France will 100% retaliate. Unlike the current scenario where even if the country is an EU ally, France can still choose to refuse.
Later down the line, France could even choose to delegate nuclear hosting to those countries, like the US does with Turkey and the like. Obviously those nations don't get access to the codes.
At the end of the day, everything works on the basis of trust, and while the US has broken its covenant, the EU countries have not, especially not with each other.
I would not be so sure with the 100%. France had a mutual defence treaty with Czechoslovakia in 1938. They not only chose not to honor it but U turned all the way and explicitly let Hitler occupy it.
Would you trust them in crunch time mere 90 years later?