There’s really nothing preventing an LLM from having the context a doctor does. The two avenues of context gathering by the doctor are:

- looking at their medical history/charts

- asking follow up questions

An LLM based system is trivially capable of doing both of those.