alt Hacker NewsLocal AI is almost impossible right now with the prices of RAM and GPUs and the sizes of decent models. No way spending even an optimistic 10k, but more likely 20k, on a setup that is good for 5-6 months makes any financial sense.
Local AI is almost impossible right now with the prices of RAM and GPUs and the sizes of decent models. No way spending even an optimistic 10k, but more likely 20k, on a setup that is good for 5-6 months makes any financial sense.
Not yet, but it's only a matter of time. Local AI doesn't need to be bleeding edge either. Even capabilities of older modals would be fine.