Ok... and where did the LLM get such information?

Did you miss where I said "surely you can also Google such topics"?

I mean it's right there in your quote actually, in the last paragraph. Sort of undermines your point, no?

So why not ban Google? Are LLM providers less likely to work with the government? Don't we assume if you type something sketch into Google the government knows? Why would the LLM be any different?

Just doesn't make sense. Appealing to RANDs expertise is one thing but we can also employ some common sense. The takeaway from this should probably be if someone really wants to make and deploy a bioweapon they probably already could. Perhaps this then means mitigations already in place are sufficient. After all, most people aren't psychopaths.