logoalt Hacker News

justapassengertoday at 5:50 AM1 replyview on HN

You basically need both. Parameters and good post training. If you keep on growing both, you’ll have good models.

LLMs are still surprisingly “easy”. You need maybe a couple dozens of right people, a lot of good quality data and a lot of GPU that you know how to operate. There’s relatively little “secret sauce” needed.


Replies

FergusArgylltoday at 6:31 AM

I think there's still a ton of secret sauce needed for serving them economically

show 1 reply