I think the issue is that people see them as agents of themselves with the authority to act on their behalf, much like a personal assistant, rather than a coworker.