> I'm having flashbacks to every time I've tried to convince these things that they're screwing up, watching the tokens burn.
that makes me think you should get credits when you are having to correct the system.
> Why aren't they getting better at this? Are some of them getting better at this?
they lack critical thinking, reasoning, logic, skepticism, self-reflection, common sense, amongst other things. They also don't learn. They get trained, but they don't learn once they're out there.
I like when I ultimately have to fix a problem in code on my own, I tell the LLM that I did so, and it responds “nice! What was the fix?”
You want me to pay you for wrong answers, and then provide you with the correct answer FOR FREE? Nah. Keeping it to myself.