We archeological evidence of broken bones that healed. If you are alone in the woods fractures would be deadly, but humans generally exist in society, and society often (not always!) takes care of them own. Maybe you can't walk, but we will carry you around and hunt food and such until you heal. Clearly their rest of life was worse after the fracture, but it is also clear that many had a long life after the fracture.