logoalt Hacker News

dogma1138yesterday at 4:44 PM2 repliesview on HN

It doesn’t need to know about QM or reactivity just about the building blocks that led to them. Which were more than around in the year 1900.

In fact you don’t want it to know about them explicitly just have enough background knowledge that you can manage the rest via context.


Replies

tokaiyesterday at 4:49 PM

I was vague. My point is that I don't think the building blocks are in the data. Its mainly tertiary and popular sources. Maybe if you had the writings of Victorian scientists, both public and private correspondence.

show 1 reply
viccisyesterday at 6:03 PM

LLMs are models that predict tokens. They don't think, they don't build with blocks. They would never be able to synthesize knowledge about QM.

show 2 replies