Just do it the way HN does it -- have a "super downvote" button. HN's "flag" operates this way, usually takes care of "politics".