logoalt Hacker News

cmayesterday at 10:27 AM0 repliesview on HN

The paper says:

"Kimi K3 uses no explicit positional embedding (NoPE), and instead encodes positional information implicitly through the recurrent gating and decay mechanism of KDA."