Decent Windows uninstallers have a checkbox for that. Often disabled by default.

It's not universal, but at least it's possible. Not having to hunt down random directories (or buying a program to do it for you) also has advantages to user control.