logoalt Hacker News

villgax • today at 7:30 AM • 0 replies • view on HN

And the fact that you will never be benefited from the batching they’ve explained either, you’ll be paying for every token sequential or parallel unlike nvidia or amd gpus