Yeah, I hear you - and sometimes, when you get it to do what you want, some system update will force a reindex and you are back to square one.

On the bright side, there are a few power scripts that allow a much more custom experience (particularly if you are an all keyboard shortcuts person), but I am not the kind that wants extras there.