logoalt Hacker News

neonstaticyesterday at 6:34 PM0 repliesview on HN

My observation is - pasting long documents is a great way to burn tokens. Turn based conversation, even a very deep and technical one, consumes less tokens than "read these logs and tell me where the problem is". Ironically, the log reading example is a perfect use for a local LLM.