logoalt Hacker News

Court: 4th Amendment Disallows Use Of AI-Generated 'Probable Cause'

58 points • by defrost • yesterday at 10:56 PM • 18 comments • view on HN

Comments

jp57 • yesterday at 11:22 PM

I know it's from the original headline, but I feel like "doesn't cover" is confusing wording. The article means the fourth amendment disallows the use of AI-generated probable cause.

A quote from the court (re-quoted from the article): "The Fourth Amendment to the United States Constitution does not allow a detective to delegate to AI the task of assessing probable cause. In other words, the Fourth Amendment does not permit an individual to be arrested based on nothing more than an uncorroborated conclusion by AI that the individual in question has committed a crime. And no reasonable detective in the Defendant’s position could conclude otherwise."

Using "cover" here strikes me as weird, since the fourth amendment prohibits government action, I would interpret actions not "covered" as not prohibited and hence allowed.

➕ show 4 replies
jawns • today at 12:17 AM

The right way to interpret this ruling is that a probable cause affidavit needs to offer evidence that a person has committed a crime, and model output is not evidence; it is more akin to an investigative tool.

Photographs, witness statements, direct observations, physical objects found at the scene are all evidence: They help answer questions such as "Was this person present at the scene?" or "Did this person take the actions they are alleged to have taken?"

A machine-learning model, even a very sophisticated one, is really at its core a probability machine. It might help you find two photographs that appear very similar, but it doesn't independently establish that the people in those photographs are, in fact, the same person. Likewise, an AI model might help you determine the similarity of speech patterns or writing styles, but those similarity scores don't actually tell you if an audio or writing sample came from the same person.

The person who submits the affidavit is vouching for the reasonableness of the facts they are presenting, and so any probabilistic evidence needs a human judgment call.

The wrong way to interpret this ruling is that AI can't ever be used as an investigative tool to establish probable cause. A detective certainly can use an algorithm that searches a facial-identification database, or a fingerprint database, to help identify potential suspects. But they then need to do something else to determine whether the model output actually matches the facts of the case. They can't just say, "The computer told me so."

AnimalMuppet • yesterday at 11:10 PM

Good!

Note that this isn't just a case of a suspect trying to deny a warrant. This is the suspect, after the case was dismissed, coming after the cop financially for the completely bogus arrest warrant. And the court ruling said that "no reasonable officer" could rely on AI as the sole determinant that a warrant was justified. That wording means that the officer can't use "qualified immunity" to get out of this.

So this is a pretty big deal. However, it's just a single decision. It's not an appellate decision, which would be binding on a district, still less a Supreme Court decision, which would be binding on the whole country. Still, it's a start. A very nice start.

➕ show 1 reply
treetalker • today at 12:52 AM

U.S. District Court for the Eastern District of Kentucky.

bitwize • today at 3:06 AM

Well, so much for the Instant Justice Machines... for now, anyway. https://www.youtube.com/watch?v=EERFGTQ2Vs0

(this show was cyberpunk af and had no right to go as hard as it did for an 80s toy-commercial kids show)

emscb • today at 12:20 AM

According to the article, the policy already said facial recognition alone is not enough, but this still happened. Wouldn’t a process where a warrant request can’t go forward unless the verification steps are recorded be more useful? It also seems the bar for getting the warrant was a bit low.

➕ show 1 reply
Molitor5901 • yesterday at 11:53 PM

(To be clear, I don’t specifically know if this detective has these prejudices, but the chain of events in this case certainly support an assumption of this person’s assumptions, if you catch my drift.)

This feels irresponsible. The author is basically calling the Detective a racist when that is not in evidence. It's an assumption, which this case is based on. I would have hoped the author would have avoided making the same mistake.

➕ show 1 reply