That is an overly broad generalisation. Where I live, golf courses aren’t irrigated at all - they just rely on rainwater, like every other farm does.
One of the golf courses near me has tee times for $10. I do not consider that something that only “serves the wealthy”. They also periodically close the course and open it up for RC plane enthusiasts.
Another one you can easily go for a walk in - I often do. It is effectively a public space.
Irrigation isn’t the only concern but also the loads of herbicides and pesticides that get dumped on them.