/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

1 vote210 views1 answer
Why when I merge my label cluster with my dataframe i get more row
Python
0 vote228 views1 answer
Matplotlib boxplot remove outliers
Python
3 votes218 views1 answer
Add images in readme github file
Python
0 vote198 views1 answer
Check pd.NaT python
Python
1 vote193 views2 answers
Changing default python version ubuntu
Python
3 votes194 views1 answer
Python how to find the highest number in a dictionary
Python
17 votes217 views3 answers
Python radians to degrees
Python
0 vote203 views1 answer
Classification algorithms pythonb´
Python
3 votes197 views2 answers
Get columns based on dtype pandas
Python
1 vote191 views1 answer
Th2=cv2.adaptiveThreshold(img, 255 ,cv2.ADAPTIVE_THRESH_MEAN_C, cv2.THRESH_BINARY, 11 # no of block size , 2 #c)
Python