Do you have eval testing? Benchmarks? Deterministic model checkpoints? Deterministic harness versioning?
Building "orchestration" without being able to deterministically measure improvements is not engineering, it's cargo cult.