The security model of Ledger wallets should survive even a compromised computer/phone, assuming you have an out-of-band way to compare address destinations and hashes.