alt Hacker NewsI pay API rates via OpenRouter / Fireworks, and I find it challenging to hit the $20 mark.
If I was to do anywhere near that kind of work on Anthropic, I'd find myself running out of tokens, waiting days to continue working, and leaning on their el-crap models to try to avoid running out again. This happens all the time.
This way I get to leverage DS for nearly all my work, benefit from its far superior latencies, and I still get to lean on OpenAPI / Anthropic or whatever SOTA models I want when I need them.
The only time that really falls down is if I'm doing huge amounts of real novel work, which hasn't been the case for a while.
Unfortunately, Fireworks is not keeping up with new models the last few months. When we selected them as a vendor, they were crushing it, new models were available in 1-2 days. Now they want us to "request" them in Discord, instead of making them all available.
I use OpenCode at home, this is one of the reasons.
Their Ember-1 model (Kimi K3 tuned to think less) hallucinates to high hell, I have no trust of it, nowhere to provide feedback, despite their launch post saying they would like feedback. That they loudly and proudly claim their internal devs notice no difference is a huge red flag for me. It says there is too much eyes free coding, I noticed the hallucinations and false claims of task completion immediately.