logoalt Hacker News

netinstructionsyesterday at 5:31 PM0 repliesview on HN

Unfortunately, the table of models and tokens per second (TPS) and time to first token (TTFT) is not helpful without specifying the quantization of the model.