If they sell enough of it in the US and buy enough in London, traders who take the other side of that position will physically move it to London.

That's exactly the service the commodities markets provide: they will absorb a small trade without anyone incurring the costs of shipping precious metals, and they know who to call to get it shipped once there's enough supply/demand imbalance to make shipping it worthwhile.