I guess if moving through time other than forward like normal it'd justify calling time a new dimension on which you can play on.

Otherwise, we just focus on the 3D space they represent and take time for granted