How about sampling more from the more "prominent" areas of the image[0] and less from less "prominent" areas?

[0]: https://dgroshev.com/blog/okmain/img/distance_mask.png?hash=...