Well, more correctly the difference needs to exceed the breakdown voltage of the insulation barrier. Or (depending on the insulator) some current might flow the entire time, but a limited amount.