The water flows whichever way there's a gradient of height.
Don't create gradients you don't have dams for.