Strictly speaking, a hardware wallet doesn't hold your "money". Your assets live on the blockchain, and your seed phrase generates the private keys that control them.
The hardware wallet is just a sandboxed interface between you, your seed, and the blockchain. It requires a computer to connect to you and the internet.
In other words: as long as you have your seed phrase (and your passphrase, if you set one) on a piece of paper, you can smash your hardware wallet to bits and be fine.
(This assumes a standard single-signature wallet using the BIP-39 standard)