It can learn very well within its context. And it can leave notes for itself to read into future contexts.

That's learning, whether you agree or not, and whether you like it or not. Baby steps, yes, but walking nevertheless.