logoalt Hacker News

zozbot234yesterday at 10:10 PM0 repliesview on HN

Tensor parallelism is not useful on consumer platforms with slow interconnects, unless compute is really low and you prioritize decreasing latency over throughput. pipeline parallelism (and potentially expert parallelism) are more workable.