logoalt Hacker News

esttoday at 6:13 AM1 replyview on HN

This is a surprising good read of how LLM works in general.


Replies

samwhotoday at 10:05 AM

It’s funny, I didn’t set out for that to be the case. When I pitched the idea internally, I wanted to scratch my own itch (what on earth is a cached token?) and produce a good post. But then I realised I had to go deeper and deeper to get to my answer and accidentally made a very long explainer.

show 1 reply