logoalt Hacker News

Dfoltoday at 2:07 PM2 repliesview on HN

So the people using the Claude consumer chat products pay for them via usage...

That's not any better. It's actually worse.


Replies

simonwtoday at 2:13 PM

I don't understand.

System prompts are part of the software that customers pay to access.

Complaining about that is a bit like complaining that your Netflix subscription includes paying to execute the compiled code that Netflix wrote that serves you video streams from their servers.

Actually there is a difference: If Anthropic deleted a large chunk of that system prompt I guess you might get like a 1% increase in how much Opus 5 you can use via their chat allowance for your paid subscription.

Is that really something worth being frustrated by?

TZubiritoday at 2:18 PM

Cached.

they are the first part of the input and it contains no user dependent variables, so the model is in a known state that it can reuse across all users, it does not need to recompute all that inference

show 1 reply