logoalt Hacker News

zozbot234yesterday at 2:49 PM0 repliesview on HN

Should run just fine with CPU-MoE and mmap, but inference might be a bit slow if you have little RAM.