alt
Hacker News
tacitusarc
•
today at 2:02 AM
•
0 replies
•
view on HN
But attention/KV cache is the heavy bit in long context lengths which is what everyone needs…