This. If the LLM has access to the outside world through its harness, then it can do real damage - data exfiltration, etc.

> You wouldn't use a C++ compiler binary provided by CCP, right?

Racism aside, one can prove a compiler is correct. It can be shown beyond a shadow of a doubt that a compiler produces correct output for a given input.

Would you use such a piece of software? Or is the boogeyman too scary?

> You wouldn't use a C++ compiler binary provided by CCP, right?

Why not? Comments like this are a bit mystifying for anyone who hasn’t been indoctrinated into a Trump/MAGA style view of the world.