I think not physically holding your bullion is equivalent to not your keys, not your crypto.

I do small amounts of both.