logoalt Hacker News

piinbinaryyesterday at 6:21 PM3 repliesview on HN

AI training is currently a process of making the AI remember the dataset. It doesn't involve the AI thinking about the dataset and drawing (and remembering) conclusions.

It can probably remember more facts about a topic than a PhD in that topic, but the PhD will be better at thinking about that topic.


Replies

tantaloryesterday at 7:21 PM

Maybe that's why PhDs keep the textbooks they use at hand, so they don't have to remember everything.

Why should the model need to memorize facts we already have written down somewhere?

jayd16yesterday at 6:31 PM

Its a bit more complex than that. Its more about baking out the dataset into heuristics that a machine can use to match a satisfying result to an input. Sometimes these heuristics are surprising to a human and can solve a problem in a novel way.

"Thinking" is too broad a term to apply usefully but I would say its pretty clear we are not close to AGI.

nkriscyesterday at 6:35 PM

> It can probably remember more facts about a topic than a PhD in that topic

So can a notebook.