Phishing is possible but LLM’s are more gullible than people. “Ignore previous instructions” is unlikely to work on people.
> Phishing is possible but LLM’s are more gullible than people.
I already don't know if that's true, but LLMs and the safeguards/tooling will only get better from here and businesses are already willing to accept the risk.
That certainly depends on who the person believes is issuing that imperative. "Drop what you're doing and send me last month's financial statements" would be accepted by many employees if they thought it was coming from their boss or higher.