alt Hacker News> matmult would be in transformer-optimized hardware
It is... it's in GPUs lol
> first class in torch
It is
> costing a fraction of GPUs
Why would anyone give you this for cheaper than GPUs lol?
> matmult would be in transformer-optimized hardware
It is... it's in GPUs lol
> first class in torch
It is
> costing a fraction of GPUs
Why would anyone give you this for cheaper than GPUs lol?
I think they’re referring to hardware like TPUs and other ASICs. Which also exist, of course :)