/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

0 vote249 views1 answer
How to flatten the image dataset
Python
2 votes288 views1 answer
Add header to table in pandas
Python
1 vote305 views1 answer
Print console sys.stdout
Python
0 vote269 views1 answer
Os.startfile on raspberry
Python
0 vote240 views1 answer
Mhaan meaning in english
Python
0 vote268 views1 answer
Python - extract min and max values per each column name
Python
4 votes287 views2 answers
Get terminal size python
Python
0 vote262 views1 answer
Python size of linked list
Python
1 vote308 views1 answer
Django queryset average of unique values
Python
0 vote255 views1 answer
Freqtrade - sell after x candels
Python