Very easily, they do it for their API. You just set a limit in tokens.
On what tokens? The ones of today's model, or tomorrow's?
The API makes it simple, yes. They make you pay per token per model. A new model has different prices. Not being able to do that is what makes it not so very simple.
alt Hacker News
On what tokens? The ones of today's model, or tomorrow's?
The API makes it simple, yes. They make you pay per token per model. A new model has different prices. Not being able to do that is what makes it not so very simple.