I started creating internal models using it, then the Gated Deltanet 2 came out( https://arxiv.org/abs/2605.22791), and it seems like an evolution of it in expressiveness. And in our tests it is really better than.
Is it just me or does this read like a re-implementation of LSTMs?
Is it just me or does this read like a re-implementation of LSTMs?