Why does it change whether it's discrimination or not depending on who does it?

I don't see how the distinction is material.