Except LLMs provide this data all the time
https://theoutpost.ai/news-story/ai-chatbots-easily-manipula...
If your argument is that the guardrails only provide a false sense of security, and removing them would ultimately be a good thing because it would force people to account for that, that's an interesting conversation to have
But it's clearly not the one at play here.
If your argument is that the guardrails only provide a false sense of security, and removing them would ultimately be a good thing because it would force people to account for that, that's an interesting conversation to have
But it's clearly not the one at play here.