alt Hacker NewsI think you are underestimating the strength a small model can get from tool use. There may be no substitute for scale, but that scale can live outside of the model and be queried using tools.
In the worst case a smaller model could use a tool that involves a bigger model to do something.
Small models are bad at tool use. I have liquidai doing it in the browser but it’s super fragile.