You have to consider the fact that it's really weird for everyone to know that evidence against you exists, but be forced to pretend it doesn't and hide it from the jury. It's not at all self-evident that this is the only, or the best possible, remedy against the government abusively collecting this evidence from you. Ultimately it's very important for the good functioning of society that guilty parties are appropriately punished and innocent parties are exonerated, and disregarding evidence can harm both goals. It's of course also important that the government doesn't seize your property or violate your privacy without a reasonable cause, but this doesn't necessarily conflict with the primary goal of justice.

Also, the good faith exception is supposed to be relatively weak - it's supposed, at least originally, to only apply in cases where the officers performing the illegal action had no reasonable way of knowing that it is illegal; the original case is quite clear - a search was conducted in one state based on an out-of-state warrant, and that warrant itself was later deemed to have been improperly issued. I find it quite reasonable to say that the officers conducting the search had no reasonable way of knowing that this warrant was problematic. If the good faith doctrine was watered down so much that an "oops, I didn't know I was breaking the law" from an officer is enough, then the problem lies with these standards, not with the principle.

This is mostly true.

You have to remember that evidence exclusion for a constitutional violation is a modern thing, and it is what's known as "judge made," e.g. it wasn't made by legislature, it was invented by the courts. (Miranda warnings are the same -- I remember one time-travel book I was reading where the guy went back to 19th century New York and was complaining about the police beating him and not reading him his rights)

So sometimes it can be kinda hand-wavy and bullshit, especially using the "good faith" exception which has been very over-used in the last decade or so, especially because of new technologies, which gives a get-out clause to the police unless the exact fact pattern of their "search" exactly matched some previous case that was solidified in appellate case law in their state or federal district, or by SCOTUS.

“Haha oops” isn’t good faith. You’re making a false equivalence here.