Not cost competitive. The performance difference is not commensurate with the price.
Model | Cached Input | Input (Miss) | Output
---------------|--------------|--------------|----------
Tencent Hy4 | $0.042 | $0.83 | $2.50
DeepSeek (peak)| $0.006 | $0.30 | $1.20
DeepSeek (off) | $0.003 | $0.15 | $0.60Wild that this is the first question I ask at this point. After that it’s a question of how it stacks intelligence wise vs glm or ds.
OAI / Ant are in for a reckoning.
We've moved past per token cost a long time ago. Smaller models use more tokens. What's interesting is the cost per task, on that front deepseek isn't particularly good.
https://artificialanalysis.ai/#intelligence-efficiency-tabs