https://cognition.com/frontiercode
Quality vs cost - medium is the sweet (perhaps better too!) spot.
my issue with frontier code is that it uses a model judge for quality whereas slop code bench forces a model to grapple with its own garbage code in order to receive a functionality reward
alt Hacker News
my issue with frontier code is that it uses a model judge for quality whereas slop code bench forces a model to grapple with its own garbage code in order to receive a functionality reward