alt Hacker NewsI would like a standardized API for local AI to exist outside of the Apple ecosystem. The Prompt API is Chrome is halfway there.
* What is the answer to local AI for native apps on Windows?
* What is the answer to local AI for Linux?
This is a big opportunity for Linux, given the high quality of open-weight models. I hope some answer emerges before designs fracture and we get a dozen mutually incompatible answers.
Replies
franze • yesterday at 9:41 PM
i researched that question for apfel https://github.com/Arthur-Ficial/apfel and standardized API is openai api so thats what i went with
➕ show 1 reply
> What is the answer to local AI for Linux?
run an ai api endpoint on a unix domain socket