logoalt Hacker News

choldstaretoday at 4:42 AM1 replyview on HN

Not really - on prem llm hosting is extremely labor and capital intensive


Replies

applfanboysbgontoday at 4:47 AM

But can be, and is, done. I work for a bootstrapped startup that hosts a DeepSeek v3 retrain on our own GPUs. We are highly profitable. We're certainly not the only ones in the space, as I'm personally aware of several other startups hosting their own GLM or DeepSeek models.

show 1 reply