Meta is one of the companies that motivated OS developers like Apple to add granular permissions to photos for the exact concerns you have.

If I was you I’d go further. In fact, I have, I deleted all my Meta accounts.

Encourage your friends and family to move to something better like Signal.