Yup, that is indeed a part of the problem. You'll notice I did say, "Obviously not feasible in practice."
I've got a textbook on field experiments that refers to these kinds of questions as FUQ - acronym for "Fundamentally Unanswerable Questions". You can collect suggestive evidence, but firmly establishing cause and effect is something you've just got to let go of.