My understanding is that von Braun was fine with using slave labor to build the wartime rockets. He wasn't just some nerd totally detached from Nazi atrocities.

I don't know what Musk's real politics are, but at the moment at least there is no evidence that he is as bad as von Braun.