/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

14 votes260 views2 answers
Select DF columns python
Python
15 votes252 views4 answers
How to find last element in array python
Python
2 votes269 views1 answer
Set http response content type django
Python
0 vote248 views1 answer
Dynamically created queryset for PrimaryKeyRelatedField in drf
Python
0 vote250 views1 answer
What is a good django orm cookbook
Python
11 votes249 views1 answer
Python windows os.listdir path usage
Python
0 vote259 views1 answer
How to access value from <class 'pandas.core.indexes.numeric.Int64Index'>?q=int64.index
Python
0 vote292 views1 answer
Flask multuple parameters
Python Flask
0 vote243 views1 answer
Range endpoint
Python
-1 vote256 views1 answer
Numpy apply function to array
Python