I suspect that's because you wrongly assume the other side is saying "some regulations have downsides". It's more likely they're saying "all regulations have unintended consequences" and thus deserve extra scrutiny when considering them.

If that is the case, then the analogy is fitting again; even "good" restaurants are often a poor substitute for eating at home, and so shouldn't be a first line of consideration.