alt Hacker NewsI’m pretty sure people are using them for local inference. Token rates can be acceptable if you max out the specs. If it was just the harness, they’d use a $20 raspberry pi instead.
I’m pretty sure people are using them for local inference. Token rates can be acceptable if you max out the specs. If it was just the harness, they’d use a $20 raspberry pi instead.
It is just for the harness. Using a Mac Mini gives you direct access to Apple services, but also means you can use AppleScript / Apple Events for automation. Being able to run a real (as in not-headless) browser unlocks a bunch of things which otherwise be blocked.