alt Hacker NewsCool — but is that model really the right choice for the task?
I guess it is only 3B active which helps a lot but is Gemma 4 E4B not more practical?
Replies
0xbadcafebee • yesterday at 7:46 PM
Qwen 4B and 9B should be faster and better reasoning than Gemma 4 E4B. Other good options for that much RAM are Gemma 4 12b and 31b. Gemma 4 E4B would be better for native audio, but OP is using Whisper for STT so prob doesn't matter
➕ show 1 reply
Qwen3.5-4B would be a good (better?) candidate. It uses a gated, deltanet hybrid, so your KV cache stays nearly flat as context grows, important for RAM-constrained environments like the Pi.