they have 2 interfaces each so you typically daisy chain them
That will hurt latency and latency is very important for good tensor-parallelism performance
That will hurt latency and latency is very important for good tensor-parallelism performance