The used model is 9B even with a big context you can easily run it on 16GB. You don't need a $2500 machine for it.
For coding and personal assistance the context window on 16GB is not good enough. Ideally I want a context window of 100k.
alt Hacker News
For coding and personal assistance the context window on 16GB is not good enough. Ideally I want a context window of 100k.