So, you bet on a) transformers can't be a load-bearing part of AI, and b) whatever replaces them will not be able to utilize TPUs. Do you have any reasons for those assumptions?

Looking at your history it's something like "I tried them and they hallucinate" and, possibly, you've read an article that talks about inevitability of hallucinations. Correct? What's your reason for thinking that hallucination rate can't be lowered to or below the human rate ("Damn! What I was thinking about?").