You have to be very deliberate about this I find. The number of people who, for whatever reason, buy into the "introvert" mentality: proudly claiming it online, wearing cancelled plans or lets stay in t-shirts, etc is partly responsible for this I think.

In my experience, if you don't accept the first invitation you're much less likely to get another one for repeat events.