I'm building this in the hope that AI will be cheap one day. For now, I'll add many optimizations
Yes, it certainly makes sense if you have the budget for it.
Could you share what it costs to run this? That could convince people to try it out.
AI is cheap right now. At some point the AI companies must turn to generate profit
Have you tested this with a local model? I'm going to try this with GLM 4.7