Gemma4-E4B (4B params) works pretty well as a local wiki, or when you don't have connectivity.
Nitpick: Gemma4-E4B is actually a 8 billion param model, but only 4.5B params worth of memory bandwidth needed per decode.
alt Hacker News
Nitpick: Gemma4-E4B is actually a 8 billion param model, but only 4.5B params worth of memory bandwidth needed per decode.