How about if people with a higher reputation contribute an exponentially higher score when voting? Like, someone with ten top-rated answers has a 1,000-point vote (more nuanced than that, obviously).