Presumably at the time they've given you their phone number, they've told you that they are on WhatsApp, and then you've responded directly that you're only on Signal.

If there is a communications channel by which they can give you their phone number, you can use that same channel to discuss what messenger to use.