logoalt Hacker News

embedding-shapetoday at 3:37 PM1 replyview on HN

> Corporations are almost entirely run by AI agents, when they sue each other they use AI lawyers and verdicts are delivered by AI courts, all within milliseconds so they're basically constantly suing each other many times a second in an attempt to overwhelm each other's compute resources. -> this looks on track to happen

Woah, sounds dystopian, what gives you the impression that this is on track to happen, is there "AI lawyers" already, or what's going on?

The few times I've read about AI/LLMs being used by lawyers or others in relation to law, it's always about "Someone tried to use AI, AI hallucinated and now the lawyer lost his license" which sounds proper and the "right way" to me.


Replies

collingreentoday at 4:08 PM

A few current situations that are leaning this way in theme:

- ai facial recognition used by police, detaining innocent people with no recourse or consequences

- ai military decisions made without human in the loop. Double points for the decisions being to kill someone. Anthropic insisting a human should be in the loop for killing decisions is what caused Trump to declare them a supply chain risk.

- ai denial of insurance claims without a doctor in the loop

- ai "plagiarism" detection in college courses failing students

- that one colleague everyone has who throws slop over the wall and just sends any feedback directly to the ai

The thing you mentioned, human judges and harsh penalties for unsupervised ai lawyering, is trying to hold this kind of nightmare back. It will be very hard (and only get harder) for humans to fight through the deluge of slop, especially if the slop is weaponized as a kind of DoS like in the book. I don't expect laws are strong enough to hold this back but I don't know any other tool in our collective toolboxes.

show 1 reply