They can have a pretty good LLM running in there, or cad design. For the average joe, having the free tier of AI without the breach of privacy is pretty good already.
For the average joe, spending $10k on the server-grade hardware needed to run the GPU, plus $100-$200 per month for power is not a great investment.
For the average joe, spending $10k on the server-grade hardware needed to run the GPU, plus $100-$200 per month for power is not a great investment.