A couple years ago I realized that I had somewhat subconsciously made the same assumption. The thing that snapped me out of it was my awe in watching Clickspring (YT) try to recreate the Antikythera Mechanism. That device's complexity and craftsmanship is proof to me that despite the lack of technology, there were some astonishingly smart and resourceful people living thousands of years ago.
Maybe they learned from the aliens?