logoalt Hacker News

neilellistoday at 6:48 PM1 replyview on HN

Also FYI doesn't run inference on Apple GPU (only for training)


Replies

HenryNdubuakutoday at 6:51 PM

Hey there, yep we found that on Apple devices specifically running on CPU is fast enough that Metal support is not needed. Thanks for flagging this though, and if usecases that would benefit from Metal support come up we will be adding it to the binaries.