As a hiring manager, I can assure you that’s not true.
If you cannot explain why a successful candidate was chosen without bias, then you shouldn’t be interviewing candidates to begin with.
But it is always worth keeping a copy of your interview notes just in case the candidate asks for feedback.