I feel like it's more to say that, "getting eaten was a legitimate concern" they weren't really the single top of the food chain because there were other animals that would reasonably consider them prey. Cave lions were massive and definitely targeted neanderthals.