logoalt Hacker News

Routine8502 • today at 12:38 AM • 1 reply • view on HN

Enough! I think it's a reasonably fair test of the models. Let's put it this way, I use the same process to resolve problems outside my peak expertise, and I find it works well.

I think the solution is easy enough that any competent colleague would come up with it. Some variant on it has probably even been published (hence why I'm not chomping at the bit to publish). I think it comes down to the models being extremely spiky, and the problems they're trying to solve being easily verifiable in code.


Replies

Buttons840 • today at 1:33 AM

Have you ever told the AI your answer? I bet if you did it would train on it and know it going forward.

➕ show 2 replies