Most people don't have your luxury of not worrying about government overreach.
It sure would have been useful for governments in the South to grab the location data of enslaved people trying to escape—would they, like the average user today, have known to turn off these settings?
It's great for Texas to buy data from brokers about women trying to access reproductive healthcare across state lines from apps carelessly sharing it. The courts don't pose a risk to you until the law changes and suddenly they do.
This is about the government getting data through a loophole that violates the 4th amendment—the difference between a society that collects everything and presumes guilt, and one that targets specific people when they're suspected of a specific crime.