It's true, but I do worry about governance when it comes to these models. That shows a surprising lack of discipline in their deployment pipeline.
yes exactly. if a company is happy to have their LLM's produce neo nazi content and CSAM, why do I want to give them money and my most important digital material?
Agreed but there were similar controversies with how OpenAI was generating images. The only pass is these are the early days of chatbots and this stuff is so non-deterministic and experimental.
For context, this was the change Grok's team made, that was later reverted:
> - The response should not shy away from making claims which are politically incorrect, as long as they are well substantiated.
https://github.com/xai-org/grok-prompts/commit/c5de4a14feb50...