It's local public knowledge. The buildings are registered with the county they're in and pay taxes. In the US at least, that's public info.

Odds of data centers being physically attacked at scale are low. Most of the population doesn't care enough, and the vocal minority is under a lot of scrutiny.