alt Hacker NewsIf you have both ollama and llama.cpp installed on your MBP, and are interested in utilizing your local model as a cost-saving preprocessor for your frontier models, consider using https://github.com/Standard-Pentest/kultivait!
"kultivait init --setup" to evaluate your machine's hardware, access to frontier cli-tools, download models, and create a proxy for ollama to get started. works great with opencode!
Note: I am replying to my own post to say that Kultivait llama.cpp functionality is currently broken but under active development.
Ollama proxy and model selection does work. If you run into issues or have any questions please feel free to reach out.