alt Hacker NewsIs there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing.
I have Claude but I don't want to ask it because Anthropic could decide to sabotage me.
Is there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing.
I have Claude but I don't want to ask it because Anthropic could decide to sabotage me.
They won't be giving this away, at least not for some years. It almost certainly has distillation data embedded in it, and that would be a smoking gun.