logoalt Hacker News

jdw64today at 4:05 AM1 replyview on HN

I want to make something in this area(LLM). Can you recommend any books?


Replies

hodgehog11today at 4:19 AM

Books? No, not really. Maybe others will have better suggestions for newcomers, sorry. Are you talking research novelty or just applying current methods to a given task?

The latter is covered well by Andrej Karpathy's videos and by just playing around with current models and other tutorials in a small test environment. You don't need to know very much, there's a lot of low-hanging fruit.

For the former, the field is moving rapidly and most of the innovations are coming from papers. Any book that claims to cover deep learning is almost inevitably outdated. Find a university or institution near you and see if they have an undergraduate reading group on deep learning that is open to the public to attend. Mine does, and it's really helpful for staying up to date with the latest ideas. "Probabilistic Machine Learning" by Murphy contains the material that I would consider prerequisite if you want to understand the ideas which underpin modern deep learning (even if it contains virtually no deep learning in it), and I would hope that any student or colleague of mine would be familiar with most of it. But I'm not sure it's good to learn from, and picking all that up takes a while to be honest.

show 2 replies