logoalt Hacker News

Analemma_today at 1:31 AM1 replyview on HN

Are people really trying to cut the token counts of their manually-typed prompts? Obviously it's good to do what you can to trim skills, documentation that gets ingested, or anything which is in an automated pipeline, but trying to police your typing like this in a live chat session just seems like making yourself crazy to save a fraction of a cent.


Replies

542458today at 2:35 AM

Agreed. Saving maybe a dozen tokens is meaningless when a task can easily chew through ten thousand times that many. A single misdescribed task will use more tokens than all my spelling mistakes all year.