logoalt Hacker News

Grimblewald • yesterday at 11:53 PM • 1 reply • view on HN

I dunno, I never sense nerfs for local models, but consistently a few months after launch for corpo hosted models, seems odd my internal model for the capacity of a model drifts for anthropic models but not local ones. I've been using LLMs heavily even before ada/babbage/davinci days, and trust my internal calibration over baseless handwavey explanations for why im imagining things, especially when I have data that shows capacity regression on frontier models for tasks, e.g. one shot success at loss, 0 success in 15 attempts once nerf is sensed. Others publish their quantified capability regressions which are also more trust worthy than this kind of handwaving.


Replies

eulgro • today at 12:25 AM

Your comment makes no sense. How and why would a local model be nerfed anyway...?

➕ show 1 reply