alt Hacker NewsSoftware wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?
Software wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?
Maybe https://mlx-framework.org
FWIW, Ollama, LM Studio and Lemonade (and oMLX) also wrap Apple's MLX framework.