Chevron Deference was in force for decades but it was based entirely on[0] "the whims of 9 unelected people". The entire doctrine rests, like the present use of the Commerce Clause, on the Supreme Court choosing some particular interpretation. The nature of such things is that they're arbitrarily disputable and revocable[1].
It's somewhat unconvincing to me, and likely many others, that rules with force should be instantaneously created but cannot be instantaneously revoked. I think the two go together. If deference is congressional intent, congress can explicitly delegate to an agency. If Chevron Deference is congressional intent, congress can explicitly set that to be the default.
0: to use the terms you use, and not because I agree
1: as perhaps the current understanding of the Commerce Clause should as well