I think you must be charismatic and somewhat attractive to inspire people to come hang around you. People will likely assume any event you invite them to will have other people that are similar to you, and by extension, if they are hanging around you it must mean they aspire to be similar to you.
If you can throw money at it, you can offset attractiveness and to some degree, personality. Having a sweet home theater, indoor pool, or gaming room/bar can go a long way to creating an inviting environment for others.
This is the most jaundiced, obviously false, and self-pitying statement I have maybe ever encountered. Have you seen a group of people paint Warhammer figurines together? Or do Gunpla? Or play a roleplaying game? Are they cool and attractive? No! Are they having fun and bonding? Yes! The only incentive one would ever have to deny this is self-loathing covering up a fear of rejection. Go out there and do something dorky with people.