- LLMs can't learn, therefore, LLMs are only good for things on which they are trained. - Captchas are not friendly with trial and error, so agentic solutions also don't help. - It's impractical to train LLMs on everything. - We humans are capable of creating infinite ways of captchas.
While each of these sentences is true, captchas will always win against LLMs.
A captcha a LLM can't be trained to defeat is likely a captcha humans will struggle quite a bit with.