Gravity does not work in our favor. It takes energy to go towards the sun.