"Waves hands at AI/LLMs"

The problem is that training these models and using these models has required exponentially increasing amounts of memory.

ChatGPT has existed for years and in those years it's userbase and model size has increased tremendously. Not to mention the fact that a lot of competitors have sprung up in the wake of GPT. Including the likes of cloud based open model hosting services.