Use the -u flag instead of -a. Doesn't add new files, just existing ones.