Oh my god, we have these "it's regulatory capture!" populists even on HN now? I thought we were better than this.
They want coordinated action to prevent a multipolar trap and potential catastrophe by future superintelligent AI (which may emerge quite rapidly if RSI ever hits an inflection point). It's not rocket science. The rules would apply to everyone. The rules they're advocating for are not "only OpenAI and Anthropic can make AI".
Give me a break. It's possible to actually think Eliezer Yudkowsky is a complete lunatic and his Roko's Basilisk essay should've been the end of him as a "thought leader" in the AI space. He has close ties to Altman, Musk, Thiel, and others, so as far as I'm concerned it's just an End Times cult.