> provide the public keys to my clients
How does this part happen? How does the client know that the entity providing them with that public key is who they claim to be?
they can fetch the key or its hash from DNS. it's not like the current system is that much more involved. current system is basically a third party signed cache of such ownership claims validated based on ability of someone to modify DNS records.
All caches are just functionally useless layers..., so that's that.
You visit the bank in person and the bank gives you the keys in a flash drive, QR code, printed paper, ... Then you go home and install the keys