It's not that it's difficult to turn off TAA: it's that so many modern techniques do not work without temporal accumulation and anti-aliasing.
Ray tracing? Temporal accumulation and denoising. Irradiance cache? Temporal accumulation and denoising. most modern light rendering techniques cannot be done in time in a single frame. Add to that the fact that deferred or hybrid rendering makes implementing MSAA be anywhere between "miserable" and "impossible", and you have the situation we're in today.
A lot of this is going to come down to taste so de gustibus and all that, but this feels like building on a foundation of sand. If the artifacts can be removed (or at least mitigated), then by all means let's keep going with cool new stuff as long as it doesn't detract from other aspects of a game. But if they can't be fixed, then either these techniques ought to be relegated to special uses (like cutscenes or the background, kinda like the pre-rendered backdrops of FF7) or abandoned/rethought as pretty but impractical.