"they don't actually learn"
Give the LLM agent write acces to a text file to take notes and it can actually learn. Not really realiable, but some seem to get useful results. They ain't just text generators anymore.
(but I agree that it does not seem the smartest way to control a plane with a keyboard)
If thats youre definition of learning, my casio FX has an "ans" feature that "learns" from earlier calculations!!