logoalt Hacker News

xscotttoday at 11:55 AM0 repliesview on HN

All the terms are squishy, but being sloppy about it, I think there's intelligence that needs to be in the model, and knowledge that could live in a database. Right now, models are memorizing a lot of stuff they don't need to. We know how to index lots of information on (comparatively slow) SSDs or across a network.

See Karpathy's "Cognitive Core" idea. (I don't have a good link)