I think Clive James said that, or something similar. I think his version was something like "the tragedy isn't that so many Australians are descended from convicts, but that so many are descended from the guards."
The guards are in charge there as everywhere else.