logoalt Hacker News

intorio • today at 5:06 PM • 0 replies • view on HN

Not only is inference currently much cheaper than people seem to think, it is going to get much cheaper. NVIDIA’s Vera Rubin is going to drive costs down for current models considerably.