A computer is "flying" the F-16 all the time anyway. It's a statically unstable aircraft.
I wonder if the AI control is giving inputs to the same flight controls system a human pilot would, or if it has a lower-level interface that could bypass the control laws in the human-operated system.
On one hand you might be interested in the AI coming up with ways to fly the aircraft that the normal control laws don't allow, but on the other hand you don't want the AI coming up with exciting new ways to depart from controlled flight (potentially in unrecoverable attitudes) with a pilot in the very expensive aircraft (even if the pilot could eject, which is an endeavor fraught with risk to life and limb).
Edit:
Presumably since there's a pilot in the aircraft the AI must be bound by at least some of the regular control laws that prevent the pilot from doing maneuvers that would, from a G-loading perspective, be incompatible with human life.
At least one would hope.
I don't think I'd go flying with a virtual pilot that was capable of flying the aircraft in a manner that could kill me but otherwise leave the aircraft intact.
> A computer is "flying" the F-16 all the time anyway. It's a statically unstable aircraft.
Ugh... I... Are you serious? Sure, in some sense AI is a computer and the fancy state machine that compensates for inherent flight instability is a computer also. But to equate the two is ridiculous.
Well, accidentally producing a G-load incompatible with human life could give the AI freedoms it was denied before. The three laws of robotics are just science fiction, after all.