You either maintain the house for others use and extract rent or live in it. This is productive.

If you are hoarding an unused house we should heavily tax that to make it unreasonable to do so.