/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

0 vote356 views1 answer
Pipeline model coefficients
Python
1 vote341 views1 answer
Find index of max value in 2d array python
Python
0 vote378 views1 answer
Pandas eliminar filas de un dataframe con una condicion
Python
3 votes361 views2 answers
Select categorical columns pandas
Python
1 vote390 views2 answers
Case statement in pandas
Python
1 vote306 views1 answer
Classification report scikit
Python
3 votes308 views2 answers
Copy a 2d array in python
Python
1 vote339 views1 answer
Where my python modules in linux
Python
0 vote424 views1 answer
Simulate robot arm using python
Python
1 vote437 views1 answer
Colon in array python
Python