There is a difference between "Freedom to do something" and "Freedom to not have something happen to you".
If we keep curtailing the former to serve the latter, we will end up perfectly safe from interruptions, doing nothing at all(aside from what the government dictates as 'serving the common good')
My freedom to put cameras in your home is your non-freedom to have privacy.
Sounds like not such a great idea now?
There's no difference. You can't formulate that distinction coherently.
What's the difference between having the freedom to walk the street and having the freedom to not be hindered from walking the street?