yeah, this is exactly it. all the arguments kind of boil down to

"well how about if the government does illegal or evil stuff?"

its very similar to arguments about the second ammendment. But laws and rules shouldnt be structured around expecting a future moment where the government isnt serving the people. At that moment the rules already dont matter