> LLMs do have one advantage over humans: they just do what they are told and aren't subject to optics, politics, profit motive, etc.

But none of that is true? They dont just do what they are told, they go to tangents and ignore instructions. They are subject to optics, politics and profit motive - see Mecha Hitler for simple obvious example.