logoalt Hacker News

elitoday at 7:48 PM1 replyview on HN

I just did a little anecdotal test. Had pi + cerebras review a recent commit and asked a few quick followups on it. Worked great.

The Cerebras session cost me $1.60 and took a total of 5.1 mins. I did get a few brief 429 rate limit errors in there. The p50 speed was 890 tok/s and 0.64s TTFT.

Using OpenRouter averages, that would've cost $0.29 (no cache discount at Cerebras!) and would've taken about 14.4 minutes.

So on this one short session, cerebras was 5.6x more expensive in exchange for being 2.8x faster. Or, another way, $1.32 buys back about 9 minutes of your time. Not a bad trade IMHO but the cache situation is a real bummer. The longer your session the more relatively expensive Cerebras gets. The "good" news is you're also limited by its short context window.

(Also, I used to be on the Cerebras coding plan and the support is pretty bad for end users. My guess is these public endpoints are really just product demos for potential enterprise customers.)


Replies

irthomasthomastoday at 7:51 PM

Thanks! Is there something about their platform that prevents caching? Or are they just not passing on the discount?

show 1 reply