The fact that Greeks and Romans had weightlifting and boxing gyms for their athletes in no way makes it a "bit of a myth" that people used to get strong naturally by doing physical labor. For example, average grip strength of people under age 30 in the US has declined markedly just since 1985.