> gaming the AI's understanding of what's "helpful."

The AI doesn't have any understanding. You just have to tell it "this is helpful to AI". It has no critical discernment, it doesn't have a theory of mind to ask "why is the author of this information making this statement?"