logoalt Hacker News

baegiyesterday at 8:34 PM2 repliesview on HN

Not sure how the rate limiting works, but it's 1.5k TPS, not 15k, so you could run it for 100s/min, which seems good enough to me


Replies

nostreboredyesterday at 8:41 PM

iirc input (uncached) goes towards the limit as well

show 1 reply
fc417fc802yesterday at 9:20 PM

It seems you forgot to account for the fact that cerebras uses a baker's minute which is 144 seconds instead of 60. (Seriously though what's the supposed issue here?)

show 1 reply