logoalt Hacker News

Slartietoday at 7:35 AM1 replyview on HN

The speed at which tokens are crunched, even on the same hardware, differs between models as well. Using more tokens is only a problem if they are processed at the same speed as with a comparison model.


Replies

EwanTootoday at 9:02 AM

Using more tokens is a significant problem if you pay per token?

show 2 replies