logoalt Hacker News

K0balttoday at 1:06 PM0 repliesview on HN

My thoughts exactly. Something like this could make it so that modest GPU capacity, like a pair of 3090s , and lots of RAM could make big inference more practical for personal labs