alt Hacker NewsNo shit its cheaper and faster, thats the case with every small model.
It's a trade off between wanting something dumber but fast and cheap, or something slower and more expensive that is vastly more capable and smarter.
Replies
ShinTakuya • yesterday at 7:26 PM
The reason the comparison is being made is because Jev and Luna 6 have similar levels of accuracy...
But the thing is that across a lot of classification benchmarks, Jev is actually faster, cheaper, and smarter than Luna (at least without reasoning). For example, look at this one from another user in this thread [1]
[1] https://hard-decisions.anth.us/models/