The contribution of the crystal to the overall tank circuit Q is vastly higher, by several orders of magnitude, than the contribution of the varactor diode.

So while making an oscillator steerable inevitably increases its phase noise slightly, the increase is either ignorable in practice or cancelled by the control loop itself.