logoalt Hacker News

ModelForgelast Sunday at 9:50 PM0 repliesview on HN

The ollama one uses even less (around 13 GB), which is nice. Apparently the gpt-oss team also shared the mxfp4 optimizations for metal