logoalt Hacker News

calebhwin • yesterday at 2:53 PM • 1 reply • view on HN

How are you benefiting from prompt caching for simple classification?


Replies

zihotki • yesterday at 3:03 PM

There are two parts in the data you supply to Jev for classification - the prompt describing your classification and the data. The data can be quite small - a simple chat message. And prompt part could be considerable since you need to describe your rubrics well.

With Jev you each time pay for your prompt, you can't cache it.

➕ show 1 reply