"I don't want to associate with you" and "You betrayed my trust" are two different things. The latter says you intentionally caused me harm, the former does not. I don't consider it normal to wish well on people who intentionally cause me harm.