alt Hacker News> AI-generated text is increasingly optimized for other goals like math, code, and reasoning
Yes, this is a problem.
AI-generated text is used internally by the AI to instruct agents, etc. And for feedback loops in reasoning. If you optimize for the result only, the AI will increasingly speak "AI", not human.
But, if I understand this correctly, if we make it speak "human", then we lose the accuracy of the results, and we're back in hallucination land.
I mean, maybe that's all right for when it's producing code - code is not beautifully flowing prose in the first place.