Presumably the airport or airline has agreed to (or would agree if asked to) have TSA decide whether you are “free to go that way, towards the airplanes”.

You are already free to go that other way (towards the street), but not necessarily free to go the way you want.