You cannot in fact be made liable for defamation for calling someone a racist.

(Patrick, a close friend I have known for many years, is not a racist.)