logoalt Hacker News

solid_fueltoday at 1:07 AM5 repliesview on HN

I really don't get why people continually fail to understand this.

Even simple issues like prompt injection are unfixable given the architecture of LLMs.


Replies

JoshTripletttoday at 3:22 AM

That's certainly true. The problem is, some people learn that and go "and that's okay", rather than "so they shouldn't exist and we shouldn't build them".

Lerctoday at 1:45 AM

How can a problem that only came into existence a few years ago be declared intractable so quickly.

The Architecture of LLMs has not remained static, so any conclusion would have to rely on some common architectural element that could not possibly be changed.

Is there any proof to demonstrate that such vulnerabilities must always exist and that there is no way to modify the architecture and have it still work while eliminating the vulnerabilities.

That would be an extremely difficult thing to prove. It is however what you would have to do to declare the problem unfixable.

show 2 replies
anuramattoday at 1:27 AM

> issues like prompt injection are unfixable

how is it unfixable? do you mean "there's always a positive chance"?

show 3 replies
denkmoontoday at 1:14 AM

hopes and dreams are one hell of a drug

infectotoday at 1:14 AM

I don’t get it either. I think there is a reasonable expectation to try to catch these things but at the end of the day it’s figuring out some form of probabilistic outcome.

show 1 reply