It seems to me that you're the one confused?

The mathematical symbol is just a representation of a concept, it's not infinity itself, you've got it backwards.