alt Hacker NewsFable was refusing to patch vllm for me when trying to get mtp to work on r9700 gpus. Kept on bumping down to opus. Tried to really sanitize my prompts and everything but it seemed intrinsically prohibited from doing this sort of work. I guess it’s useful for making inane one shot games and websites, lol.
Replies
I was recently using self-hosted DeepSeek V4 Flash to poke around the DSpark implementation in vLLM (well outside of my domain)
I did wonder if I was doing anything Fable would have flagged - sounds like yes.
That's where the free marketing comes from.
same experience here, as soon as it touched any gpu code it stopped working
Anthropic's TOS clearly says they don't want to facilitate any sort of distillation, it's not a stretch to think they will limit any sort of learning on improving other models.
> Tried to really sanitize my prompts
And in doing so, you probably got your account and prompt flagged for 'attempted jailbreaking' (apparently, such scores are remembered for up to 7 years).