People will insist otherwise, but I haven't seen anything close to sonnet 4.6 that can be run locally.
I don't think anyone can honestly say a huge frontier model is actually going to be matched by something running on 64gb locally?
alt Hacker News
I don't think anyone can honestly say a huge frontier model is actually going to be matched by something running on 64gb locally?