logoalt Hacker News

vulture916 • today at 8:00 PM • 3 replies • view on HN

Jev = $0.042/m input, output free Clef = $0.24/m input, no output price listed

At 300 tokens per call, you'd get:

One million decisions on Jev cost about $12.60. One million decisions on Clef cost about $72.

Would probably make sense to self-host Clef, if you have the capability/resources. If not...


Replies

strangescript • today at 11:15 PM

Because Clef is a larger model, larger context, can process images. Plus its open weights, so you can run it yourself.

Since it benches better than Jev, Jev is probably smaller and easier to host. They could also be losing a lot of money.

scronkfinkle • today at 8:30 PM

> no output price listed

It's weird to think of these kinds of models as having "output tokens". Cross-encoder approaches like Laya add a [MASK] marker per option, but nothing is generated the way an autoregressive transformer generates. It's one bidirectional pass over your input, then a small head scores each option, so you wouldn't really pay for output as much as only input

jampekka • today at 8:22 PM

Output for decisions have so few output items (not really tokens here) that they are negligible anyway. Jev hyping "free output" is almost lying by omission.

➕ show 1 reply