I really don't get why people continually fail to understand this.
Even simple issues like prompt injection are unfixable given the architecture of LLMs.
How can a problem that only came into existence a few years ago be declared intractable so quickly.
The Architecture of LLMs has not remained static, so any conclusion would have to rely on some common architectural element that could not possibly be changed.
Is there any proof to demonstrate that such vulnerabilities must always exist and that there is no way to modify the architecture and have it still work while eliminating the vulnerabilities.
That would be an extremely difficult thing to prove. It is however what you would have to do to declare the problem unfixable.
> issues like prompt injection are unfixable
how is it unfixable? do you mean "there's always a positive chance"?
hopes and dreams are one hell of a drug
I don’t get it either. I think there is a reasonable expectation to try to catch these things but at the end of the day it’s figuring out some form of probabilistic outcome.
That's certainly true. The problem is, some people learn that and go "and that's okay", rather than "so they shouldn't exist and we shouldn't build them".