logoalt Hacker News

I were 17, I'd learn how to build LLMs from scratch

168 pointsby bilsbieyesterday at 8:38 PM245 commentsview on HN

https://xcancel.com/paulg/status/2091544343589060625


Comments

zombottoday at 9:11 AM

I would not waste my time with yesterday's fad. The next unicorn generator will be something else.

keyboredtoday at 7:57 AM

YC Combinator guy says that with a time machine he would learn to build the currently trillions-valued or whatever technology. Okay.

vascotoday at 6:52 AM

Can't this guy enjoy being rich in silence? His takes get worse with every passing year.

show 1 reply
bewareofscamstoday at 9:16 AM

Venture capitalist suggests everyone to become his future employee, just as he has been (successfully) doing for his whole life.

yapyaptoday at 7:49 AM

This is always such a nonsense question-answer thing, asking a person who already succeeded what they would do if they were young.

Even worse when they ask themselves.

show 1 reply
dakollitoday at 7:38 AM

What the fuck does this guy know about? I'm sure if we went back through similar statements he's said over the years he's said the same thing about various technologies that are no longer relevant. The guy is a talentless hack who larps as a blogger and his only "redeeming" quality is having lots of money.

Owner of Golf Club Company says I should dedicate my life to golf lmfao.

hugodantoday at 8:34 AM

hackers and painters and kids and ROI and startups and capitalism and the destruction of nature and old guys with money talking like they know better in fascist social networks

show 1 reply
dismalaftoday at 7:24 AM

The amount of people who missed the point here is absurd. He's advocating for learning about how LLMs work. For the sake of learning. Because no one's going to invent the next thing without at least some understanding of the current thing.

maximgeorgetoday at 9:21 AM

[dead]

luciana1utoday at 9:35 AM

[dead]

BoredomIsFuntoday at 6:53 AM

I do not think it is a proper thing to do for 17 y.o., unless they are exceptionally mathematically gifted, as proper understanding of how LLMs are trained requires a good grasp of calculus, understanding modern OS and SDE tools for proper implementation of pipeline etc.

I'd rather simply write another mnist implementation and check if I really like all that AI stuff at first place. Even then, before going into mature-on-the-way-to-dying tech (LLMs) I'd rather focus on fundamentals - good ols linear models, regressions, stat etc.

show 6 replies
Freedom2yesterday at 10:00 PM

Another great quote by PG. I've been really enjoying his essays recently - truly a great and curious mind.

a2800276today at 8:05 AM

If I were 17, I wouldn't be using a social media plattform run by racist neo-fascists...

Cheyanayesterday at 9:34 PM

He bases this decision on all of the experience he has amassed, as a 61 year old man in the tech industry. An actual 17 year old, with 17 years of experience, would not think like this, nor should they.

show 3 replies