For K3 read this instead: https://arxiv.org/abs/2607.24653

The main contribution of the K3 paper is Stable LatentMoE. Like some other models it compresses data sent between layers, which puts certain requirements on the router. K3 improves performance by using a more balanced expert selection strategy.

Rather under-discussed back then: https://news.ycombinator.com/item?id=45766937

I believe OP posted it because the new Kimi K3 has 69 KDA layers (the rest are 24 Gated MLA), I think previous large Kimi models had only MLA layers.