alt Hacker News> This is why I use AI for all my medical questions and doctors use AI to write software, and we both smirk at the quality the other person is getting from it.
There is an interesting third group emerging: People who acknowledge the quality problem, but think they can deal with it by applying more AI to the output.
This takes the form of people who spin up a lot of "agents" and give them personalities like security director or quality director (which are unnecessarily complex and maddeningly unpredictable ways to trigger an LLM session for doing a security review or a quality check pass).
It also includes the person who knows that their app is full of bugs, but thinks it's not a problem because they can have the AI fix the bugs as they show up. People in this class haven't encountered security breaches or data loss bugs yet. They think it's all about having Claude fix that div that isn't centered or handle that error code that shows up some times.
Replies
> There is an interesting third group emerging: People who acknowledge the quality problem, but think they can deal with it by applying more AI to the output.
Ah yes, the known unknowns.
The discussion reminds me of a talk Zizek gave in which he discusses the speech Rumsfeld gave regarding the evidence Iraq supplying weapons to terrorist[0].
Zezik argues the unknown knowns are far more interesting (and the reason why USA was losing in Iraq). While Rumsfeld focused on the unknown unknowns.
I've noticed that domain experts who implicitly know the the known unknowns of their field distrust LLMs because they can identify their shortcomings. Those subtle mistakes LLMs make. I argue this is why domain experts using LLMs get such a boost. They can identify and avoid pitfalls sometimes before they happen. But in other fields the same people are in awe of LLM capabilities precisely because the known unknowns are a mystery.
The Unknown Unknowns of LLMs are the IMO the most interesting. The so called emergent capabilities of the technology. The use of LLMs in others fields such as biology, eg in protein language models, is really cool.
Everyone focuses on replacement of people workers when I think opening new fields of work for humans should be the goal of LLMs by leveraging the tech to discover.
The other interesting caregory is unknown knows. But that's another topic for another time.
[0] https://en.wikipedia.org/wiki/There_are_unknown_unknowns
I always imagine the model rolling its silicon eyes when it’s assigned a personality (“you are an expert growth hacker”) at the start of the prompt. Was that ever actually shown to be effective? Is it still?
How did you get over 52,000 karma in under 3 years with no submissions at all?
Are you averaging like 2000+ comments a month?
> People who acknowledge the quality problem, but think they can deal with it by applying more AI to the output.
Brute Force: if it doesn't work, you're just not using enough.
What if they're right though?