logoalt Hacker News

adrian_btoday at 11:31 AM1 replyview on HN

NVIDIA could make 2 separate products, a GPU for gamers and a FP accelerator for HPC.

Thus everybody would pay for what they want.

The problem is that both NVIDIA and AMD do not want to make, like AMD did until a decade ago and NVIDIA stopped doing a few years earlier, a FP accelerator of reasonable size and which would be sold at a similar profit margin with their consumer GPUs.

Instead of this, they want to sell only very big FP accelerators and at huge profit margins, preferably at 5-digit prices.

This makes impossible for small businesses and individual users to use such FP accelerators.

Those are accessible only for big companies, who can buy them in bulk and negotiate lower prices than the retail prices, and who will also be able to keep them busy for close to 24/7, in order to be able to amortize the excessive profit margins of the "datacenter" GPU vendors.

One decade and a half ago, the market segmentation was not yet excessive, so I was happy to buy "professional" GPUs, with unlocked FP64 throughput, at a price about twice greater in comparison with consumer GPUs.

Nowadays, I can no longer afford such a thing, because the similar GPUs are no longer 2 times more expensive, but 20 to 50 times more expensive.

So during the last 2 decades, first I shifted much of my computations from CPUs to GPUs, but then I had to shift them back to CPUs, because there are no upgrades for my old GPUs, any newer GPU being slower, not faster.


Replies

david-gputoday at 12:11 PM

Throughout this article you have been voicing a desire for affordable and high-througput fp64 processors, blaming vendors for not building the product you desire at a price you are willing to pay.

We hear you: your needs are not being met. Your use case is not profitable enough to justify paying the sky-high prices they now demand. In particular, because you don't need to run the workload 24/7.

What alternatives have you looked into? For example, Blackwell nodes are available from the likes of AWS.