logoalt Hacker News

win311fwg • today at 1:20 AM • 0 replies • view on HN

> But then again plain LLMs have been perfectly cheap and serviceable as zero-shot classifiers for quite some time now

I'm no prompt engineer, but I've found them to be too slow any time I wanted to use them that way. I have never tried Jev, but apparently it is supposed to be fast, so it seems like, according to the marketing, it could become usable where LLMs haven't been.