Instead of trying to get at the same origin point, I usually just keep the selection active and then go to "Selection" menu and choose either "Shrink" or "Expand" options (or similar language: I use a localized version).