> human-level to run on a single 16GB GPU before the end of the decade.
That's apparently about 6k books' worth of data.
For the weights and temporary state, yes. It doesn't sound like a lot until you remember that your DNA is about 600 books worth of data by the same metric.
How many humans do you know who can recite 6000 books, word for word, exactly?
For the weights and temporary state, yes. It doesn't sound like a lot until you remember that your DNA is about 600 books worth of data by the same metric.