alt Hacker NewsThis is a serious problem with the fact that it's nearly impossible to understand what a "token" is and how to tame their use in a principled way.
It's like if cars didn't advertise MPG, but instead something that could change randomly.
Replies
amitprasad • today at 12:18 AM
Relevant post: https://modal.com/blog/dollars-per-token-considered-harmful
(disclaimer: I work with the author)
➕ show 1 reply
uoaei • yesterday at 11:39 PM
Like if cars measured fuel efficiency or range using the knobs in the tread on your tire.
smohare • today at 3:28 AM
[dead]
Also, certain models are more verbose than the others. We are basically at the mercy of a model who likes to ramble a lot.