logoalt Hacker News

cjbgkaghyesterday at 2:57 PM1 replyview on HN

I’m running Gemma4 31B (Q8) on my 2 4090s (48GB) with no problem.


Replies

Glemllksdfyesterday at 3:56 PM

I have the same setup but tried paperclip ai with it and it seems to me that either i'm unable to setup it properly or multiply agents struggle with this setup. Especially as it seems that paperclip ai and opencode (used for connection) is blowing up the context to 20-30k

Any tips around your setup running this?

I use lmstudio with default settings and prioritization instead of split.

show 1 reply