alt Hacker NewsWell, a model by itself with data that emits a bunch of human written words is literally no different than what JIRA does when it reads a database table and shits it out to a screen, except maybe a lot more GPU usage.
I permit you, that yes, the data in the model is a LOT more cool, but some team could by hand, given billions of years (well probably at least 1 Octillion years), reproduce that model and save it to a disk. Again, no different than data stored in JIRA at that point.
So basically if you have that stance you'd have to agree that when we FIRST invented computers, we created intelligence that is "thinking".
Replies
You're getting to the heart of the problem here. At what point in evolutionary history does "thinking" exist in biological machines? Is a jumping spider "thinking"? What about consciousness?
>Well, a model by itself with data that emits a bunch of human written words is literally no different than what JIRA does when it reads a database table and shits it out to a screen, except maybe a lot more GPU usage.
Obviously, it is different or else we would just use JIRA and a database to replace GPT. Models very obviously do NOT store training data in the weights in the way you are imagining.
>So basically if you have that stance you'd have to agree that when we FIRST invented computers, we created intelligence that is "thinking".
Thinking is by all appearances substrate independent. The moment we created computers, we created another substrate that could, in the future think.