Wouldn't it run on a $50 raspberry pi?
Probably the same people getting a macbook pro to handle their calendar and emails
I thought I had heard that the integrated RAM/VRAM makes local LLMs fairly quick on a RAM-maxxed Mac Mini.
alt Hacker News
I thought I had heard that the integrated RAM/VRAM makes local LLMs fairly quick on a RAM-maxxed Mac Mini.