I have given this serious thought over the years. I even have an unfinished novel exactly around that topic.

Energy. The key is controlling their access to energy.