On the one hand you say we should retain judges making sentencing adjustments where appropriate, but who judges the appropriateness of the adjustments?
It sounds like if an extenuating circumstance resonates with a judge, then the sentence will get modified. Sentencing shouldn't be based on a single person's "feelings."
Ultimately responsibility lies with the people electing either judges directly or representatives who appoint judges. We must choose people of proper demeanor who will make sound decisions when required. It takes effort on our part to be knowledgeable and vocal, but it's the price for living in a world where we are not at the mercy of unfeeling automatons.