logoalt Hacker News

yumraj10/11/20241 replyview on HN

Can it use GPU if available, say on Apple silicon Macs


Replies

unkeen10/11/2024

> GPU on MacOS ARM64 is supported by compiling a small module using the Xcode Command Line Tools, which need to be installed. This is a one time cost that happens the first time you run your llamafile.

show 1 reply