Yeah, I think it might be a driver thing (or driver interaction with XFCE code).

After ~10 years of using XFCE, I recently for the first time encountered flickering, after an NVidia driver update. I disabled compositing and it went away. Still happy, but clearly something broke there. Pretty sure someone's trying to fix it, somewhere.