It's only convenient because I already use Paypal.
I only buy maybe 2-3 games a year from Steam directly. Most of the games in my library are from humble bundle (or similar sites). It's just been easier to click the Paypal button for the occasional impulse buy than to track down my wallet.
I'll probably go ahead and put my CC details in now that I know Paypal carries risk.