Developing on the Mamba 2 architecture is a really interesting point to note. It seems to be catching up to “regular” transformer architectures.