If the LLM doesn't have a websearch tool your test doesn't make any sense.
An LLM by itself is like a lossy image of all text in the internet.
Just some more parameters, and it would overfit that specific PDF too.
Just some more parameters, and it would overfit that specific PDF too.