logoalt Hacker News

zozbot234yesterday at 2:41 PM0 repliesview on HN

There's "high compute", and then there's proper HPC. AI these days is way more on the HPC end of the scale. The GPUs are doing computations using 2-bit and 4-bit numbers and not 64-bit, but everything else is going to be comparable.