logoalt Hacker News

collintoday at 8:29 PM1 replyview on HN

This was my experience a year ago on some other model they could run super fast. Routine coding tasks would hit the per-minute token limits.

Just the math there... 150k TPM... and 15k TPS means... you can run for 10 seconds every minute?

The basic math boggles the mind.


Replies

baegitoday at 8:34 PM

Not sure how the rate limiting works, but it's 1.5k TPS, not 15k, so you could run it for 100s/min, which seems good enough to me

show 2 replies