Not sure why ds cache costs are confusing? Their kv cache is absurdly compressed compared to almost everyone else.
It is confusing because they are the only ones doing so whereas everyone has an incentive to apply similar techniques.
alt Hacker News
It is confusing because they are the only ones doing so whereas everyone has an incentive to apply similar techniques.