logoalt Hacker News

zozbot234today at 8:47 AM0 repliesview on HN

ANE-powered inference (at least for prefill, which is a key bottleneck on pre-M5 platforms) is also in the works, per https://github.com/ggml-org/llama.cpp/issues/10453#issuecomm...