alt Hacker NewsI'm not a fan of Jensen by any means, but he did start the CUDA program some eight years before it was actually useful (the alexnet moment). He called the need for high performance linear algebra for scientific computing, it just took a while for it to find its first killer app.
Replies
jacquesm • today at 12:05 AM
CUDA was a formalization of what happened outside of NV.
nkassis • yesterday at 11:44 PM
That was becoming a hot topic at the time prior to DL getting on the map but it was smart to recognize the latent demand for GPGPU. Was still going to lead to solid growth with AI was just not going to be the exponential growth we saw if it didn't happen.
CUDA was well-used in HPC and other compute-intensive spaces long before neural nets were in style.
If you look at the evolution of GPGPU computing, at least from an HPC perspective, CUDA is almost an obvious step. What’s perplexing is that AMD and Intel let it get so far ahead in the late 2000s and early 2010s.