I will die on an adjacent hill: when the details had washed away with time leaving behind merely the sturdier and ugly base, people removed the garish base coat cause that thing is uuugggo! Our ancestors were thinking what we're thinking: It looks better white than with only a base.
Like spraypainting over graffitti with a drab color that doesn't match the original stone perfectly.