/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

0 vote209 views1 answer
Select first row of every group pandas
Python
1 vote238 views2 answers
Conda import django
Python Django
21 votes263 views3 answers
How to create an empty list of certain length in python
Python
0 vote225 views4 answers
Install python in dockerfile
Python
9 votes242 views1 answer
Python delete none from list
Python
7 votes226 views4 answers
Pip update django
Python Django
2 votes230 views1 answer
Flask import jsonify
Python Flask
8 votes231 views4 answers
Len function in python
Python
0 vote270 views1 answer
Get resource path python
Python
1 vote238 views2 answers
Django queryset exists
Python