Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote286 views1 answer
Print format round python
Python
0 vote409 views1 answer
Value isn't remembered in lambda python
Python
1 vote263 views1 answer
Rename the console python
Python
0 vote259 views1 answer
Check if a word is a noun python
Python
50 votes276 views3 answers
Python read arguments
Python
1 vote262 views1 answer
Comentario em python
Python
0 vote257 views1 answer
Catch error in mongo query python
Python
0 vote272 views1 answer
Python csv delete all rows
Python
39 votes259 views6 answers
Python generate requirements.txt
Python
0 vote282 views1 answer
Gravar arquivo python
Python