/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

9 votes276 views4 answers
For if else one line python
Python
19 votes299 views6 answers
For loop
Python
0 vote257 views2 answers
Scroll to bottom in selenium python
Python
-1 vote247 views1 answer
Ipywidgets pip
Python
0 vote299 views1 answer
Importing modules in kv lang
Python
15 votes274 views5 answers
Skimage python
Python
-4 votes277 views5 answers
Current django version
Python Django
15 votes258 views3 answers
Python get input from console
Python
0 vote285 views1 answer
The python path in your debug configuration is invalid.
Python
0 vote268 views2 answers
AttributeError: module 'keras.utils' has no attribute 'to_categorical'
Python