It would probably not be on tapes or punch cards these days, probably on a big nvme flash storage array (before being loaded into the enormous memories of these machines, we are talking 40-64TiB) and then backed up off site to tape, or maybe they just use Amazon Glacier (which we all know deep down is just tape lol) for that and don't handle it themselves :).