alt Hacker NewsI've been saying for a while that given a proper harness, small local models can perform incredibly well. When you have a system that can try everything, it will eventually get it right as long as you can prevent it from getting it wrong in the meantime.
Replies
cornholio • yesterday at 10:28 PM
If I understood correctly, the model will get it right because it knows when it isn't right.
➕ show 2 replies
Lol, I love that framing. Yeah, the small models have impressed me a lot during this work. The reasoning can be quite good, and definitely sufficient for a lot of cases. Just gotta nudge em back on track Every now and then and they'll figure it out.