The most obvious answer is that freedom needs no justification, restrictions on freedom need a justification.