alt Hacker News> A real nuclear engineer with the knowledge he needed would also have said "no, don't do that and I won't help you."
That sounds like what Claude would say unless he was really good at jailbreaking it, which would IMO imply he knew he was chasing after a bad idea.
Right, which is exactly what elashri is objecting to. elashri said "Why do LLMs have restrictions on nuclear science", and IncandescentGas was explaining why they think those guardrails are a good idea. You're just agreeing with them.