And this is why local AI is going to be the future.
Local AI is almost impossible right now with the prices of RAM and GPUs and the sizes of decent models. No way spending even an optimistic 10k, but more likely 20k, on a setup that is good for 5-6 months makes any financial sense.
alt Hacker News
Local AI is almost impossible right now with the prices of RAM and GPUs and the sizes of decent models. No way spending even an optimistic 10k, but more likely 20k, on a setup that is good for 5-6 months makes any financial sense.