alt Hacker NewsIf anyone needs to see what 62 tokens/second looks like: https://token.qusai.pro/?speed=62
Which seems sufficient for mortals who are not running gas town, but want a local model.
Replies
brcmthrowaway • today at 1:00 AM
Good luck when you need to prefill context..
60 toks/sec may be ok for pure chat or token generation, but not for token preprocessing nor any sort of agentic work.