The Q, K, V matrices form neural networks at runtime, that's the entire point.