Why does it matter how many deserts you cross if you never get to where you want to go? I similarly can take 10 flights across oceans but never end up in the city I'm trying to visit. Sounds like in your metaphor the person is just crossing desserts because they want to with no goal or destination in mind.
Maybe you wanted to visit Mexico and your dream was specifically about Cancún, but then you ended up in Veracruz and were like "oh well, it is Mexico after all, I'd rather be here and visit five other countries similarly than only a single one with my dream city."