It’s really cool that we have this proof that US companies are half year behind Chinese models in architecture.
Nemotron was using hybrid with recurrence via mamba layers since around April 2025.
What is the proof?
Nemotron was using hybrid with recurrence via mamba layers since around April 2025.