Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote268 views1 answer
Discord.py how to print audit logs
Python
1 vote228 views2 answers
Histogram chart plotly
Python
9 votes218 views2 answers
Python get copied text
Python
0 vote228 views2 answers
Pdf to excel conversion using python
Python
2 votes258 views3 answers
Standard deviation python
Python
0 vote204 views1 answer
Python equivalent of R sample function
Python
2 votes247 views2 answers
Pandas seaborn distplot
Python
9 votes224 views3 answers
Python export multiple dataframes to excel
Python
0 vote213 views1 answer
Pyhton apend to list
Python
0 vote220 views1 answer
Cube python
Python