I design and conduct space missions, and I'm an experienced professional pilot. The answer to your question is "never."

Any system that requires perfect performance from any one human will fail.