I suspect a lot of this is not (just) capability but bravery. A human would be daunted by even a small neural net; the task would seem too challenging to be worth attempting. Astra, fearless, just assumes an answer exists and then tries to reverse and execute on it.
I've been finding that too with these models
For example pointing them at a crash dump they manage to piece together and extract information I would not even try to extract by just looking at the raw memory