/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

1 vote302 views1 answer
Find the most similar rows in two dataframes
Python
0 vote291 views1 answer
How to print list without newline
Python
3 votes276 views1 answer
Find angle mbc in python
Python
1 vote271 views1 answer
Mean of torch tensor
Python
0 vote293 views1 answer
Sort a set in python
Python
1 vote285 views2 answers
Python conditional operator one line
Python
1 vote222 views1 answer
32 bit binary in python
Python
2 votes312 views1 answer
Add a list in python
Python
1 vote301 views1 answer
Data Compression in python
Python
18 votes291 views2 answers
Get columns by type pandas
Python