alt Hacker NewsI don't remember where I read this, but will tell this story every time ChatGPT is mentioned as a replacement of StackOverflow.
> I asked chatgpt how do I do X. Chatgpt replied with the accepted answer from stack overflow, thus saving me 1 second. In theory. In practice, what Chatgpt did NOT tell me was that the top voted comment on that accepted answer said "Do not do this, doing X in this way creates a security vulnerability of type Y because of Z"
Honestly, in this scenario I’d lean toward the LLM providing the better answer. Whoever shared this parable didn’t understand that ChatGPT isn’t just a search engine that regurgitates the top voted accepted comment from Stack Overflow. An LLM is probably more likely to parse the entire page and all of the comments if it pulls an URL. It would also be more likely to pull multiple URLs. It would also be more likely to pull from accumulated embedded knowledge. Unfortunately for this fabricated example, the casual visitor to Stack Overflow is most likely to be duped by an incorrect accepted answer if they don’t scroll down and read the fine print (which isn’t that common, a fact that surprises people who always read the comments and all answers).