Google's advancement is not just in software, it is also in hardware. They use their own hardware for training as well as inferencing [1].

[1] https://finance.yahoo.com/news/alphabet-just-blew-past-expec...