Once, a GAN model that was trained to convert between satellite images and drawn maps was caught encoding the original satellite image in imperceptible dots
The field of ML is Goodhart's law reified. We might have temporarily forgotten some of the basics of the field amidst this LLM craze.
https://arxiv.org/abs/1712.02950 (2017)
…if you’re curious and missed that one like I did. Snack-sized paper with lots of satisfying visual examples.