The autism itself, depending on the person, is often less of a problem than societal expectations. For example- in a world where everyone was red/green colorblind, such a condition would not be considered a handicap. And in a world where everyone was autistic, many things would be different.

Society punishes us severely for not being able to see the difference between red and green, to use that metaphor. And they seem to expect that if they punished us just a little harder, we would suddenly become normal. Thats the big problem. Non conforming behavior is always treated as a crime or offense on some level, but we cannot conform, and therefore must adjust to a life of endless punishment doled out by both authorities and peers.

Its quite difficult to go through life that way without developing a negative self image. This goes for people with autism, adhd and other types of neurodivergence.