I think that criticizing when it benefits the person criticizing, and absense of criticism when criticism would hurt the person criticizing, makes the argument less persuasive.
This isn't ad hom, it's a heuristic for weighting arguments. It doesn't prove whether an argument has merit or not, but if I have hundreds of arguments to think about, it helps organizing them.