A number is not in the first place its digit sequence. A number like pi is in the first place the ratio of a circle's diameter and its circumference, and only incidentally a certain (infinite) decimal expansion. A name is in the first place something you say, hence the thing you say has to be (at least theoretically) sayable.