/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

0 vote346 views2 answers
Iris data pandas scatterplot
Python
3 votes302 views3 answers
Drop variable pandas
Python
1 vote296 views1 answer
How to use pca using scikit learn
Python
1 vote303 views1 answer
Scrapy user agent
Python
7 votes296 views2 answers
How to get the remainder in python
Python
11 votes308 views3 answers
Logistic regression algorithm in python
Python
10 votes302 views3 answers
Enter selenium in python
Python
0 vote345 views1 answer
Tkinter gui grid and frame
Python
0 vote316 views1 answer
Frozen graph can't be modified
Python
0 vote364 views1 answer
How do you say not equal to python
Python