The flight control system in modern fighter jets makes human-induced departure from controlled flight difficult to get into. That's the point of the system.
There's a good F-22 pilot talk recorded at MIT a few years ago you might enjoy. The pilot described the F-22 as the easiest aircraft he's ever flown because the flight control system handles many of the considerations (stress on the airframe, staying out of attitudes that would deviate, etc) you'd have to be mindful of in lower-tech aircraft. He talked about being more comfortable putting a non-pilot into a Raptor vs. a 172.
Edit: I believe this is the talk: https://ocw.mit.edu/courses/16-687-private-pilot-ground-scho...
It is definitely possible to escape the safe flight envelope in a a stock F-16 though. The F-22/F-35 are significantly newer.
Even with a new system, stability through transonic while manoeuvring is hard, the aircraft will experience buffet, and the meat bag may have been subject to a number of high G turns. The problem is that recovery may need to happen after already departing controlled flight.
Differences between the modelled aircraft and the actual aircraft, e.g. due to icing, linearization effects on inherently non-linear systems, sensor error, actuator wear, etc, can lead to incorrect predictions, and hence moving to parts of the envelope which are not assured.