You seem to be ignoring the "just to save face" part. I'd argue it would be a worse thing for our bar for how safe it should be to be raised significantly from when we had been in space as a species less than a decade to now that it's been 65 years.

Never risk free , but Soyuz hardly lost any crew over its 50+ years

Saturn 5 had a flawless record. The leftover space shuttle parts which SLS is cobbled together from, not so much. SRBs are inherently dangerous, theyre designed to quickly launch nukes from silos, not people. And Orion is just a typical modern Boeing project. So far its fallen at every hurdle right?