You were fortunate in attending a better school.
I was an air force brat, and so attended many diverse public schools.
I took 2 years of honors physics in high school. College freshman physics blew through that in 2 weeks. And then I was in deep doo-doo.
I am eternally grateful to Prof Ricardo Gomez, who kindly took the time to coach me one on one. I never thanked him for that, one of my many regrets.
I’m a good bit younger than you (not assuming, I recognize the username :), and I think they have gotten considerably better at putting more advanced kids into classes that challenge them. I grew up in Orlando which historically has pretty poorly rated schools, but I think they were active in making sure the children are put into the right courses. I also think that there’s just more granularity now.
When I went to college, it was definitely tougher, but I was able to pass the freshman physics and multi variable calculus courses first time around, without significant tutoring.