Give them another option after they vacate the nest in the fall. You likely have the materials that they would use but they are not in prime locations for carpenter bee nests so they choose your home with a nice morning sun exposure and pre-existing nests. [0]

[0]https://gardenbetty.com/carpenter-bees/

I have carpenter bees, mason bees, bumblebees, honeybees, wasps, etc including bees of every size. I also have planted my property in native plants and wildflowers to make sure these native insects have a place to hang out. I provide water for insects and wandering animals using washtubs with stacked rocks and solar powered fountains to discourage algae. I think that you could improve your chances of keeping the bees without them destroying your siding or trim if you follow the guidance about bee house placement.

You can make a bee house block or buy one that will attract multiple native bees and they will use it for years. Here is one option with additional info about carpenter bees.[1]

[1]https://www.thewallednursery.com/do-carpenter-bee-houses-wor...

The holes in the bee house need to be about 1/2" (12-13mm) if you are attracting carpenter bees. For mason or orchard bees they should be smaller, 3/16" to 5/16" (5-7mm).