logoalt Hacker News

swalsh • yesterday at 6:23 PM • 1 reply • view on HN

I think it's a joke at this point, but also the visual benchmark is a remarkably dense method for demonstrating how good a model is.


Replies

InsideOutSanta • yesterday at 6:42 PM

Yeah, people like to poop on the pelican. But pelican quality still correlated with overall model capabilities reasonably well, and you can immediately see and interpret it. It's a running gag, but it also does have some actual value.