you use the wrong word
the Anthropic tokenizer is not worse, its more expensive/verbose
So, worse? Because we benchmark off token use when talking about token use, and everyone else understood that.
alt Hacker News
So, worse? Because we benchmark off token use when talking about token use, and everyone else understood that.