alt Hacker NewsSure, running an LLM is cheaper, but the way we use LLMs now requires way more tokens than last year.
Replies
simianwords • yesterday at 9:01 PM
ok but the capabilities are also rising. what point are you trying to make?
➕ show 1 reply
Sure, running an LLM is cheaper, but the way we use LLMs now requires way more tokens than last year.
ok but the capabilities are also rising. what point are you trying to make?
10x more tokens today cost less than than half of X tokens from ~mid 2024.