One problem is the billionaires themselves. It's too much power and influence in the hand of a single person. They can fun newspapers at loss and have them spread any kind of lies or narrowly biased news for decades.
Billionaires would be less of a problem in a world where we'd all be multi millionaires.