I think the context here is that small models run locally, not rented from a cloud.
Yes small models are and will be useful for lots of stuff for several reasons.
But the idea they’d be better than a bigger model is cope, you’re pretty much always better off running the biggest one you can bring to bear within your constraints.
alt Hacker News
Yes small models are and will be useful for lots of stuff for several reasons.
But the idea they’d be better than a bigger model is cope, you’re pretty much always better off running the biggest one you can bring to bear within your constraints.