swarmfile was built to deal with this type of problem