> Yes, they could on indefinitely

Only if they live forever, which they won't. They can only count so fast, and there are only so many of them. Even if every atom in the observable universe was counting at, idk, 1GHz, that's still a finite number. The universe is not (as far as we know for certain) infinitely old. Time may extend infinitely into the future, or it may not. We don't know. So far as we know for sure everything is in fact finite.