How are their lives being destroyed?
Being told that you have to follow the same rules as everyone else for e.g. spaces designated to be used solely by the opposite sex, doesn't seem so bad.
This is an oversimplified strawman argument. Biological sex is a complex subject. The cultural understanding of sex is complex. If I has a man take my 2 year old daughter to the men's room is that a bad thing? (For the record I don't have any children)
I don't believe you're asking this question in good faith, but there are many, many attempts at erasing them from public existence: https://translegislation.com/