logoalt Hacker News

eigyesterday at 5:14 PM7 repliesview on HN

Funny to see that they did not include Fable 5 in their GeneBench and LifeSciBench comparisons because "it does not answer advanced biology questions and refuses the majority of questions in this eval".

Winner by default!


Replies

inciampatiyesterday at 5:27 PM

This is a major reason why I and a number of biologists I've talked to have canceled their anthropic accounts recently. Not working is not working.

show 3 replies
matheusmoreirayesterday at 10:01 PM

Anthropic just refuses to allow Fable to properly code review my projects. It's so obnoxious. If OpenAI's Fable equivalent is better at this, that'll get me to cancel my Anthropic subscription and switch.

show 1 reply
mnickyyesterday at 9:20 PM

Well it seems like they removed quite a few 3rd party benchmarks they used for GPT-5.5 release where Opus 4.7 was better and added many new benchmarks created by them where conviniently GPT leads.

Seems a bit more hand picked than usual to me..

midtakeyesterday at 6:29 PM

You shouldn't know too much about biology, stupid human. You might live your life in an unexploitable way.

show 1 reply
fblpyesterday at 8:58 PM

oh that's sad, are the biolgy limitations for "safety"?

show 1 reply
paxysyesterday at 5:17 PM

Where’s the lie?