I tried the API on a coding task and it did worse than I would've hoped. Also $5. They still have a ways to go, I think.

I also use their chat pretty frequently, it seems to "misunderstand" me more often than other models. But that's free and it isn't as irritating to rephrase a question as it is backing out code changes.

I like that they have local models available, I plan to try those sometime.