logoalt Hacker News

Does Speaking to Agents Like Cavemen Save 65% of Tokens? We Test

36 pointsby Sandmanlast Tuesday at 7:37 AM26 commentsview on HN

Comments

DougN7today at 3:38 AM

I don’t know about the rest of you, but the bulk of my token usage is not what I type in - it’s that data the AI is processing for me. I’m shocked they even got an 8% reduction.

show 1 reply
jpeasetoday at 4:05 AM

Why not Mandarin Chinese? Logographic is pretty compact.

Also, this really should be more precise that it’s talking about neo-caveman. Legit caveman no speak English.

show 8 replies
NitpickLawyertoday at 4:07 AM

I think it's funny this works somewhat, but that's not what the goal is, IMO. The goal is to have the model do this internally in its "thinking" stage. On the very rare occasions in the past where gpt5 leaked its true internal thinking, the "CoT" was itself kinda similar. Instead of the open source "so the user wants me to... but wait... maybe I should... blahblah...", GPT5 was using internal traces like "try x.. no.. try y... no.. from x yes then z yes...". That's probably more token saving, or faster responses, if you can get the model to remain accurate.

pineappletooth_today at 3:13 AM

Well 8%-10% saving without measured quality degradation is not nothing, specially now that newer models seem to use more tokens than previous ones.

Also it was tested on reasoning low, i'd have liked to have them tested on higher reasoning levels.

show 1 reply
mmastractoday at 3:30 AM

I suspect this means that there's just a ~10% inefficiency in token to information mapping.

abofhtoday at 3:27 AM

If you just want a smaller vocabulary, use French? If your goal is to communicate to an LLM, maybe saving tokens isn't the all in win, unless you like reading assert gronkHitThing(true)

show 1 reply
ButlerianJihadtoday at 3:49 AM

https://groups.google.com/g/alt.nerd.obsessive/c/EGuKIN_4dME...

  alt.nerd.obsessive FAQ v1.4

  In the episode where they were filming the Radioactive Man movie [1995], the comic book store guy tells Bart that he can find out the star of the RM movie. He promptly posts a message to alt.nerd.obsessive which states "Need know star RM pic". This information is relayed through the nerd world until it reaches a nerd hiding under the table at a meeting of movie moguls casting the film. He relays back the answer immediately (Rainier Wolfcastle).
https://en.wikipedia.org/wiki/Radioactive_Man_(The_Simpsons_...
igor_nastlast Tuesday at 7:54 AM

As the test shows the real gain is somewhat marginal to most people, but still some ppl claim a wide skills portfolio is required to move faster or save tokens. Mixed feelings, I personally use superpowers as my basic setup - and only them.

What are your thoughts on it?

show 1 reply
sh34rtoday at 3:37 AM

gpt 4 moto razr wen?

altmanaltmantoday at 3:21 AM

Yes all the caveman spoke English like its freaking Flinstone. Like wtf is the caveman dilect, just english words with some randomly skipped? Why not try with actual other human languages and see if there is a token benefit in savings

show 2 replies