logoalt Hacker News

XenophileJKO • yesterday at 9:52 PM • 0 replies • view on HN

The incredible thing to me is I can say "I have a theory that X is a problem."

The agent then works for 20 minutes and comes back with, "Yes this is a problem. Here is the evidence. Here is a golden data set. Finally I built a new evaluation metric and benchmark where we can back test or use for new model experiments to see if we are closing the gap."