logoalt Hacker News

bellowsgulchtoday at 5:10 PM0 repliesview on HN

Thanks, man! I’ll go use that now that I know. llama-server the last time I used it for inference with this model wasn’t able to produce work fast enough to reach those numbers.