If it can replace any human labor, it needs to be able to negotiate. If it can't negotiate, then it can't replace people who negotiate for a living (salespeople, attorneys, HR, etc.)
Unless you mean that it would have the capacity but would be told not use it in this specific situation. It can't be programmed deterministically, and getting it to never do this emergently would take significantly stronger guardrails than anything even the frontier labs have been able to put together.
alt Hacker News
If it can replace any human labor, it needs to be able to negotiate. If it can't negotiate, then it can't replace people who negotiate for a living (salespeople, attorneys, HR, etc.)
Unless you mean that it would have the capacity but would be told not use it in this specific situation. It can't be programmed deterministically, and getting it to never do this emergently would take significantly stronger guardrails than anything even the frontier labs have been able to put together.