alt Hacker NewsUnlees you invest thousands your local ai won't even come close to the cheap cloud llms. Local is only worth it if you care about privacy or have a legitimate usage for the hardware otherwise. Money wise it isn't worth it
Replies
nicman23 • yesterday at 5:30 AM
the qwen 27b is quite good for doing a mvp
arijun • yesterday at 3:27 AM
I mean, if you're using one of the $200/month plans, you'd recoup the cost in a year or two.
➕ show 1 reply
I think you bring up a good point about privacy. Companies probably should not be handing over intellectual property to cloud AI third party vendors. Perhaps all of that should stay on-prem and then the cloud vendors could be used to fill in the gaps.