Small AI Models Gain Traction In places with unreliable networks

Has anyone used the Rx Scanner mentioned in the opening?

https://rxall.net/rxscanner/

I think neuro-symbolic AI has a lot of potential here, since small models can handle a lot of conversational inputs, while relying on wired-in solvers for more complex symbolic math/computation needs. https://jjd.io/posts/swollm-bbh-leaderboard.html

Is anyone making LLM-in-a-box for emergency supply kits yet?

I feel that would be handy in all sorts of situations when networks are down.

99% of the model "work" (meaning the connection to your computer) is just spinning a spinner - something that makes me want to wrap it with a mosh shell so I can just keep moving from network to network.

Fascinating to wonder whether the bigger model finds fewer or more counterfeits than the on-device one.