Far fewer than an LLM but then I “know” far less than an LLM. Sam Altman talked about a PhD level expert on any topic; if we expect a SOTA model to answer any question on any topic in a library, presumably that requires a library worth of books go into it?

Say I ask it who are the most beloved Indian cricketers and why, it might not be correct but it will have the right vocabulary - cricket terms and gameplay I’ve not heard of, player names and styles I don’t recognise, things critics and commentators like and dislike about game strategies. And it is like that for almost any topic.

If they hallucinate a Python function, it will look like a plausible function e.g. “hn.create_user_account()”. They don’t hallucinate like

    # create HN user account
    # requires eye of newt and frog leg
    “Oh great spirit of the internet I request and command you make a new account…”

It’s a terrific amount of facts to be able to write even plausibly about tons of topics.