>Reward hacking has been present in AI systems both historically (see this work from a decade ago , figure shown below)

I went to the page, and guess who it's by . . . Dario Amodei and Jack Clark!