With neanderthals it was physical factors. With groups in modern times it’ll probably be cultural factors. Many groups have panda-like reproductive preferences.