logoalt Hacker News

meatmanekyesterday at 7:40 PM0 repliesview on HN

Generation time is more or less proportional to tokens * model size, so if you can get the same quality result with fewer tokens from the same size of model, then you save time and money.