>I do think the pressure to be a paper machine limits people from trying bets that are realistically very likely to fail.

Oh certainly. I also think it’s just a sweet spot of efficiency and scalability that transformers happen to occupy. A new paradigm will need to be more effective at similar cost.