Their TPUSync post is highly recommended as well. This is basically how many of the open-source repos like Strata for Qwen series models are working.

https://cloud.google.com/blog/topics/ai-infrastructure/intro...

https://github.com/Niko1221/Strata/blob/main/docs/HOW_IT_WOR...