Neutrinos need a large detector volume for efficiency because they interact so rarely. You can’t detect them directly so you need a transparent medium to detect their collision byproducts. Good detector mediums are water and ice, and are underground to minimise background light. There are relatively few places you can do this. Mine caverns and under the sea are the most common, but marine detectors are notoriously hard to build. Francis Halzen proposed using ice. At the Pole, the glacial plateau is 2 miles high and the breakthrough was confirming that the ice is in fact highly transparent if you go deep enough.
Why the pole specifically? You could probably build a second IceCube 100 miles away, but how are you going to get that materials there? Pole has a skiway for large aircraft and infrastructure to house a large number of people. The traverse (SPoT) only became operational near the end of construction - the initial holes were drilled in 2005 and almost everything had to be flown in.
Telescope In The Ice does a great job of explaining the history and science behind the experiment.
The biggest challenge is finding ice without dust layers from historical volcanic activity, and the South Pole is particularly clean because of it's remoteness as well as the prevailing wind directions. There is, however, one big dust layer that causes signal distortion.