A single video card with any amount of ram is in the thousands of dollars, and you'd need a stack of them to replicate what the providers performance.

Running your own compute has a lot of risks too, you have to keep it secure against attacks on the models that you're running. Giving away all your chats to hackers because you don't secure your own stuff isn't really winning either.