logoalt Hacker News

otabdeveloper4yesterday at 8:58 PM0 repliesview on HN

> on-premise GPU cluster

Renting a GPU server from a cloud and hosting your own llama.cpp is the path of least resistance.