They talk about developing and using TileLang which they ported to Huawei's 950 GPUs.

And it makes sense, as these LLMs become more capable in coding abilities - people will use them to develop their own abstractions to work on different HW. You cannot have it otherwise. If SaaS companies get threatened that their SW doesn't have a moat why do you expect Nividia's SW to have moat ? The computing algorithms are not even proprietary. It is only a matter of whether someones cares about it and is committed. This should be encouraging for new AI chip development companies.

The very progress that Nividia enables also has a negative feedback that threatens it.