logoalt Hacker News

trentortoday at 5:15 PM1 replyview on HN

I always thought of the Pelican more of like a gimmicky quick test. There are people who took it as a serious benchmark for overall model performance?


Replies

NitpickLawyertoday at 5:18 PM

"Draw a pelican on a bicycle" is not a serious benchmark.

"Draw an animation of this long ass scene from a movie, and only call me when everything works e2e" can be.

show 1 reply