Halide had the right idea, and some of us could sense that tile-based programming would eventually go mainstream, but it never had the hardware moment to make it a real necessity. The ideas that feel obvious in retrospect are usually right on the merits years before adoption. Think arrays and APL, but it took until numpy to provide the right ergonomics for everyday developers to stop thinking in loops.

CUDA is nearly 20 years old, and is not going anywhere, for many years to come

this dude is a distinguished engineer at siemens commenting the dopiest/reddit level takes. lolol.

That's quite a claim for very little evidence.

is this even comparable? lol