If you make it more efficient, then you train it for longer or make it larger. You're not going to just idle your GPUs.
And yes of course it's a race, everything being equal nobody's going to use your model if someone else has a better model.