To tell it accurately of course takes work.
However if you live in the open, or have daily access to the open sky, after a while you are bound to notice.
We are so used to having a ceiling above us, so used to constructions blocking our view of the sky that this seems a feat.
I was the same till I got access to the sky. Then ... oh wait ... the sunset is shifting towards those landmarks every day. Oh wait, now its turning around to go the other way.
The total span of movement is so large, that its hard to miss unless you are on a featureless landscape or in the open sea.
I am super impressed by humans noticing and separating the planet's from the stars. Look at those stars they don't twinkle and they move funny. I guess the planets drew attention because of their brightness and by their lack of twinkle.