I know very little about this but why isn't it mamba-3? Isn't it... uh, more gooder?
The Nemotron 3 family uses Mamba-2 because that is what we had validated when we started building the family.
Changing the SSM backbone is a major revision, not a dot release. At least for us.
The Nemotron 3 family uses Mamba-2 because that is what we had validated when we started building the family.
Changing the SSM backbone is a major revision, not a dot release. At least for us.