logoalt Hacker News

Hasslequestyesterday at 3:46 PM1 replyview on HN

You can run the LLMs on your own machine


Replies

dakolliyesterday at 8:51 PM

It costs about 60-80k to run a 1T param model at your house.. which is the only size model that's going to get anywhere close to a foundation model's capability.