The tax is based on residency, not ownership. If nobody lives there as their primary residence, it's subject to the tax.
Simple fix, they need to put mistresses in all their second homes.
Simple fix, they need to put mistresses in all their second homes.