TPUs are systolic arrays right? So does that mean that Google is using a hetreogenous cluster compromising both GPUs and TPUs, for workloads that don't map well or at all on TPUs?
What sort of workloads are you thinking of?
What sort of workloads are you thinking of?