Oh I have really been thinking long about this. The intelligence that we have in these models represent a time.
Now if I train a foundation models with docs from library of Alexandria and only those texts of that period, I would have a chance to get a rudimentary insight on what the world was like at that time.
And maybe time shift further more.
> I would have a chance to get a rudimentary insight on what the world was like at that time
Congratulations, you've reinvented the history book (just with more energy consumption and less guarantee of accuracy)