alt Hacker NewsI took a tiny glance. At least you're taking into account compute and memory bandwidth.
You need to get more desktop GPUs on here, for the inference at home people.
I took a tiny glance. At least you're taking into account compute and memory bandwidth.
You need to get more desktop GPUs on here, for the inference at home people.
Yes, we're trying to get those ingested. We have quite a few but you raise a good point that inference at home is rising!
Part of the problem we have is some of those desktop GPUs don't have power and flops data. We're toying with the idea of writing a CLI to run/publish these but obviously a lot of work.
Cheers for engaging!