logoalt Hacker News

xnxtoday at 6:07 PM2 repliesview on HN

Good start, but needs to be harness x model to be useful. 3 top harnesses x 3 top models would be more interesting.


Replies

Edward40today at 7:01 PM

Version 1.1 will add more harnesses and evaluate a broader set of models. Rather than holding the model fixed, we plan to evaluate the full harness × model matrix to reveal interaction effects (which harnesses work best with which models) and produce a harness-model compatibility matrix.