If I am to start violent colonial project today I will care for resources not people. And depopulating an area is fixed cost.
Anyway with underdeveloped countries - you only need to bribe couple of people and you effectively run the country. Which once again is fixed cost.