Anectodically, this is pretty rare. I know quite a lot of people who used psychedelics, and they are fine. I think some important safety points is to know family history of mental illness and not do then until later in life.
And obviously, start low and see how it goes.