alt Hacker NewsCan you explain what you're using the local compute for vs. the API-based frontier models? That was entirely unclear to me.
Are you running tool calls that include inference with local fine tunes? And fast math packages? Controlled by the frontier model agents?
Is there a way folks can contribute to this?
Thank you for the questions echelon.
1) As far as the AI models go, we used GPT 5.6 Sol, Fable 5, and Gemini-2-embeddings across the system
2) Yes, the agents are given bash tools that allows them to interact with the preinstalled mathematics packages/dependencies that are on the VMs
3) This was a setup as a relatively quick project without much thought for future contributions, I will spend some time thinking about how i could make it more open.