Is it a stretch to imagine a compromised LLM writing compromising code? I've been operating under the assumption that LLM code might be bad and not working, but I hadn't thought about it compromising a system.

The attack doesn’t use AI, but an AI could use the attack. (and the researchers definitely used AI to write the paper!)

AI could enable script kiddies to pull this off.