But you already trust your client with all the private keys and message plaintexts for your account.
I struggle to see why I should trust it with those things but not the account password.
my google account has way more power over me than whatever i ever wrote in matrix in my life (ever, ever)
Not necessarily, you could give restricted access to a client