I've been using the 35B model on a 4090, tokens are ~3x faster than a MacBook but the quality is closer to sonnet 3.5 or so in my experience.

It is still incredibly impressive of course! I just wish it was jailbroken