Saying no is a privilege.
It's easy to say if you have other options.
It's extremely hard to say if others depend on you saying yes.