> Amazon uses TPUs more than it uses graviton, it trains on GCP

Can you share a source for this claim? Graviton is a CPU, it would be strange to train LLM (I assume you meant LLMs) on a CPU.