alt Hacker NewsAlong those lines:
https://news.ycombinator.com/item?id=48269481
By “their own index” i assume you mean training data? If so, thats a big part of the issue for me. As an example, if I ask an LLM for some part of the Zig stdlib, I will get an incorrect answer 10/10 times because it will refuse to look up the latest documentation.
No, I mean they're constantly crawling the web. That gets fed into the next model but it's also searchable by the current one. For example, if you ask chatgpt what the latest shooting at the white house was it will tell you about the one from two days ago.
ChatGPT has effectively assimilated Google search. You can tell it to look up the latest version of the zig docs and do whatever.