c.f. https://news.ycombinator.com/item?id=49403836, then from there, you'd need to see a couple of orders of magnitude before it's tractable for LLMs.
Bottom of page linked from HN (currently https://www.mythic.ai/) indicates they're hoping to demonstrate something that could that in 2028 or later, and both Nvidia and Cerebra are looking at 10x'ing models to 10T+ plus in 2027.
So they may never catch up on LLMs.
They're a good fit for the companies they're working with and have taken investment from, ex. Toyota, that aren't doing LLMs.
They plan to be able to run 1T parameter models next year
https://www.mythic.ai/vanguard
Seems big, IF true