logoalt Hacker News

mft_yesterday at 8:53 PM14 repliesview on HN

This post can essentially be distilled down to: yes, Fable's classifier (which is meant to downgrade cybersecurity, biology, or jailbreak attempts to Opus 4.8) is definitely overly sensitive to the point of uselessness.

e.g. a colleague asked Fable to help create an simple app to help calculate the statistics for phase II and III trials. (Ignoring that such things already exist) it passed his request down to Opus, despite only being very marginally, tangentially, somewhat related to biology.


Replies

rcovesonyesterday at 9:04 PM

And biology is by far the classifier's least favorite topic. It's not even close.

I've had it downgrade to Opus for the following questions:

"How confident are we that English and American Eels both spawn in the Sargasso Sea?"

"Come up with five Zoology questions of increasing difficulty for a trivia game."

"What's your favorite sarcopterygian?"

My wife has some zoology-related preferences in her user instructions, and she had it downgrade to Opus after prompting it with: "plant."

show 6 replies
matthewdgreenyesterday at 9:15 PM

I'm working on cryptography, all from academic research papers. Started well, but it eventually got some word into its context that is on the banlist. I found that if you tell it to fire off clean Fable subagents and you instruct it to check the Claude Code billing data to check for downgrades, you can get most high-sensitivity spec/review tasks done with Fable. Most.

I figure that once GPT 5.6 comes out, Anthropic will become interested in making the safety gate non-destructive.

show 1 reply
Certhasyesterday at 9:18 PM

My experience, too. I work on nothing in any way related to cybersecurity or biology. I asked it a few purely mathematical questions, it refused immediately.

Before the export embargo I did get it to look at some hairy problems and the output was genuinely useful...

show 1 reply
parsimo2010yesterday at 9:16 PM

Additionally, I thought the threat being modeled for “biology” was stuff like bioterroism- how to make anthrax, how to distribute a toxin, etc.

I don’t feel like calculating results for a trial is really in the threat model unless we think a terrorist is out there testing the efficacy of their anthrax before using it in an attack.

show 1 reply
smcleodyesterday at 9:22 PM

I've been working with it heavily since its first release. I use it for software architects, complex debugging and some development and I have not had it refuse or downgrade even once.

show 5 replies
bb88yesterday at 9:43 PM

I've been working on a SDN software for mikrotik routers (and wireguard, etc) and Fable dies when working with any kind of wireline protocol or potentially implementing any authentication mechanism.

It's too the point where I just stopped using it. If you do generic stuff, it's fine. But the second it tries to start debugging protocols (which may include auth) that's where it begins to fail.

show 1 reply
t1234syesterday at 8:58 PM

Anyone test the "Gay" jailbreak to see if it works on Fable?

show 2 replies
mattjoyceyesterday at 9:43 PM

The post can be distilled down to a simple statement, but part of the writing is for the author to express themselves and tell a story. I thought it was an interesting read.

SubiculumCodeyesterday at 9:18 PM

I absolutely have been unable to use Fable for any neuroimaging work. Its fine. The other models are good enough, honestly...and while I AM annoyed that the filter is so broad, I also understand it, as I do believe that models can become dangerous as WMDs, eventually. Still, it is completely useless for me.

The only question I had was being flagged for other reasons, so I asked it a mechanical engineering question, and it was just fine with that.

visargayesterday at 10:03 PM

I got downgraded to Opus for asking "What is a cell?" that's all, single message, instant downgrade.

cubefoxyesterday at 9:21 PM

My guess is the classifier guardrails were made significantly stricter to convince the US government to reverse the ban.

show 1 reply
hendersoonyesterday at 8:55 PM

If your prompt has to do with those areas, yes. I haven't seen a single refusal yet.

Reportedly the biology guiderails are particularly strict.

show 4 replies
bboryesterday at 11:11 PM

That's extremely related to biology.

simlevesqueyesterday at 8:56 PM

I've had Fable read and write code. Never saw any downgrades.