Are there some good articles/documentations about hardening a LLM harness ?
I'm currently running a setup where Claude lives in a container with zero auth token and I have a secondary gateway container that intercepts all requests that require a token and injects them into the request. For things like AWS request it intercepts the request and signs it. There's also a firewall to limit the requests it can make to a few known hosts.
I'm guessing and doing a lot of trial and errors and I want to know if there's any best practice. Googling only seems to return results from 2025 when people were just getting started with LLMs.
The best places where I get this info is from the ai engineer YouTube channel and Claude’s YouTube channel.
For effective harness engineering you need to also read the detailed prompting guide for each model. We are back at a place where every model revision introduces harness optimizations that need to happen.
You seem to be doing all the right things though. The tldr is treat your agent to be a precocious kid and the job of the harness is to helicopter parent it without the kid realizing it’s being parented.