But is arc-agi really that useful though? Nowadays it seems to me that it's just another benchmark that needs to be specifically trained for. Maybe the Chinese models just didn't focus on it as much.
Doing great on public datasets and underperforming on private benchmarks is not a good look.
Doing great on public datasets and underperforming on private benchmarks is not a good look.