What are pp/tg? I get 30t/s on 27B qwen.
pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.
alt Hacker News
pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.