alt Hacker NewsIf you read DeepSeek's papers, you'll find a litany of architectural features that allow for a greatly reduced cache hit price by shrinking the size of the KV-cache.
If you read DeepSeek's papers, you'll find a litany of architectural features that allow for a greatly reduced cache hit price by shrinking the size of the KV-cache.
How come no other big model seems to be able to deliver the same type of extremely low cache cost though, if their techniques are public?