This is backwards. You have the privilege of curating who's not there, by not inviting them. The fascinating people you do invite aren't obligated to show up.