I think the best part about this benchmark is that they finally stopped pretending you can evaluate a complex engineering task with $ 5 worth of inference. If a task takes a human weeks, you need to give the agent a comparable search space to find solutions