Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote279 views1 answer
Pandas removing outliers from dataframe
Python
0 vote279 views1 answer
Fastest way to Convert Integers to Strings in Pandas DataFrame
Python
0 vote289 views2 answers
Install python 3.6 on centos
Python
0 vote318 views1 answer
Csv module remove header title python
Python
0 vote257 views1 answer
Import nifti to numpy
Python
0 vote286 views1 answer
Integer xticks
Python
0 vote290 views1 answer
Majority in array python
Python
30 votes299 views5 answers
Generate random float python
Python
1 vote321 views7 answers
LightGBM
Python
0 vote314 views1 answer
Write a variable and assin a string to it
Python