No, I mean they're constantly crawling the web. That gets fed into the next model but it's also searchable by the current one. For example, if you ask chatgpt what the latest shooting at the white house was it will tell you about the one from two days ago.

ChatGPT has effectively assimilated Google search. You can tell it to look up the latest version of the zig docs and do whatever.