Hey just following up on this - we just shipped support for any model that supports the OpenAI Chat Completions API (1), including Ollama and Llama.cpp. You can checkout the docs here: https://docs.sourcebot.dev/docs/configuration/language-model...
[1] https://platform.openai.com/docs/api-reference/chat