logoalt Hacker News

seghyesterday at 11:03 PM1 replyview on HN

I'm curious, what is the LLM cost of the website?


Replies

drob518yesterday at 11:39 PM

I’m curious, too. But it could probably run locally with a small model, right? The performance is stellar, so that suggests some hardware acceleration is being used, but that could all be a local system.