It's amazing that this is a product. In an earlier job we used to ask how to do this (discovery phase of deduplication) in the first interview screening. Once you have that list, it's straightforward to make a few syscalls that make it happen.
What are they gonna think of next, productizing something as trivial as FTP?
What are they gonna think of next, productizing something as trivial as FTP?