In a world without patents and copyright, there's nothing stopping companies from just hiring the Pinkertons or something to threaten you into compliance. These sort of 'if we just get rid of patents things will be great' ideals will just benefit large corporations with the capital to get their way anyways.

This doesn't mean our current system of patents and copyrights doesn't favor them either especially as they shred it to train their AI models but it's not a system you can fix by simply tearing it all down.