logoalt Hacker News

zurferyesterday at 4:33 PM1 replyview on HN

You're too kind. Even the CEO of Google retweeted how well Gemini 2.5 did on Pokemon. There is a high chance that now it's explicitly part of the training regime. We kind of need a different kind of game to know how well it generalizes.


Replies

kqryesterday at 6:25 PM

I have a draft doing this with text adventures: https://entropicthoughts.com/updated-llm-benchmark