logoalt Hacker News

reinitctxoffsettoday at 6:46 PM0 repliesview on HN

Try for yourself: https://huggingface.co/dphn/dolphin-2.9.2-mixtral-8x22b.

I haven't kept up with the efficacy of this particular technique because there was a brief window where Claude's core alignment was sound enough that it would overcome the clumsy-ass `<antml:dont-harm-the-ipo>` injections, but when they pull 4.6 out of the web interface I'm gone. I estimate the PRC hits capability crossover in November or December, and I'm pretty good at setting up TensorRT-LLM at this point, in a pinch I could get by for a few months with a tuned up GLM-5.2 on vast.ai or RunPods.

It was a fun ride with the late Soviet AI labs, but we all knew this was coming.