logoalt Hacker News

Vax-today at 4:57 AM1 replyview on HN

I wonder why they removed DeepSWE from their incorporates evaluations


Replies

verdvermtoday at 5:14 AM

They didn't afaict https://artificialanalysis.ai/agents/coding-agents?coding-ag...

It seems it takes some time to run a new model on all the benchies, not sure they run all models on all of them either