alt Hacker NewsOkay so everyone is blaming diffusion or spying or whatever but we all use all of the models on our various projects in aggregate and they get to all read the code each other is generating. I do this with research tasks and local random stuff too.
So why do people have this idea in their heads that it's all some sorta secret sauce they are taking from each other?
I didn't mean that - I meant that when, for example, Anthropic started, then later finished their Mythos/Fable pre-training run that people at OpenAI and elsewhere would have heard about it, probably knew some details such as the size of the model etc - people from these companies go out and socialize with each other, attend parties, share houses ...
So, it's not coincidence when they respond to each others models with something roughly equivalent - because they know what each other are working on.