alt Hacker NewsIf you don't need SOTA or near SOTA there are plenty of dirt cheap models, just look at Gemma 4 31B on Openrouter.
Replies
ai_fry_ur_brain • yesterday at 8:01 PM
[flagged]
If you don't need SOTA or near SOTA there are plenty of dirt cheap models, just look at Gemma 4 31B on Openrouter.
[flagged]
For all of the use cases being hyped you really do, and you actually need something much better than the SOTA models to do what we are being told can be done.
The small models are useful for small things like summarizing text or search but not much else.