logoalt Hacker News

Autoregressive next token prediction and KV Cache in transformers

50 points • by coarchitect • last Sunday at 8:07 PM • 0 comments • view on HN

Comments