"I don't need to care about privacy because I have nothing to hide."

One counter is "since I've done nothing wrong, you have not need to care about what I hide". Both make assumptions, the difference is about who is trusted. Why should it be the authorities.