logoalt Hacker News

lostmsu • last Friday at 9:34 PM • 3 replies • view on HN

Is Jev any faster, cheaper, or more precise than medium LLMs like Luna 6?


Replies

ShinTakuya • yesterday at 8:32 AM

Yes. Not as fast/cheap as Typesafe claims, but lots of benchmarks suggest around 3-4 times cheaper, and 7-14 times faster.

- https://www.ml6.eu/en/blog/jev-vs-gpt-6-luna-vs-bert-text-cl... - https://tessl.io/blog/jev-is-136x-faster-and-27x-cheaper-tha... - https://x.com/fazxes/status/2100300097695232164 (this last one is Luna 5.6 but that isn't too different from 6 besides accuracy and cost)

➕ show 2 replies
IanCal • yesterday at 8:28 AM

Luna 6 is 10c per million input tokens and charges 5x that for output. Not sure if it’s still true but it used to be the case that structured outputs took time to process and cache which is relevant if the structure changes. It doesn’t give a percentage you can use for thresholds, and I’d want to know if Jen treats the questions as independent (they aren’t with luna, order of questions will change the result).

Jev is 4.2c/m tokens in and free out.

pokeapallascat • last Friday at 11:20 PM

not really

➕ show 1 reply