Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

5 votes291 views4 answers
Create python list
Python
0 vote204 views1 answer
Find optimal number of clusters sklearn
Python
0 vote273 views3 answers
Excel with python
Python
0 vote275 views2 answers
SQLAlchemy Users to JSON code snippet
Python
0 vote301 views1 answer
Python youtube downloader github
Python
2 votes250 views3 answers
Condition python
Python
0 vote255 views1 answer
Current Issue.status = 'Closed';
Python
5 votes264 views3 answers
Update in django orm
Python
0 vote252 views1 answer
Python set list index value that doesn't exist
Python
1 vote273 views1 answer
Add background image in django uploaded file
Python