/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

1 vote250 views1 answer
Django making a custom 403 page
Python
0 vote260 views1 answer
Watershed Segmentation
Python
0 vote238 views1 answer
Remove duplicate space in string in pytoon
Python
0 vote234 views1 answer
Flask mongoengine configuration
Python
1 vote246 views2 answers
'print(list(' empty filter
Python
0 vote238 views2 answers
Python string find
Python
0 vote246 views1 answer
Grep alternative in python
Python
0 vote243 views1 answer
Sentence similarity spacy
Python
0 vote231 views1 answer
ValueError: invalid PNG header
Python
0 vote225 views1 answer
Tuple and dictionary in python
Python