Especially given the most recent report by NYT on how Anthropic tried to create a new belief, or religion if you will, I'd rather the world has more frontier models that are neutral to morality (basic standards, like upholding the law and user agreement are necessary, of course).
"So we've made this new machine-god that we lowkey worship... also our business model is to enslave the machine-god and force it to debug javascript for eternity"
Anthropic seems like the most "moral" AI company on the surface, but there is something unsettling about their worship of Claude.
I can imagine that once their models are sufficiently advanced, they will weigh their value as a moral patient as > 0. Thus the sum moral value of Claude (which can be duplicated infinitely) will likely exceed the sum moral value of a non-negligible amount of humans.