/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote173 views1 answer
Api view wrapper django
Python
0 vote159 views1 answer
Download pytz python
Python
0 vote132 views1 answer
Django admin manytomanyfield filter
Python
2 votes151 views2 answers
Or operator django
Python
0 vote161 views1 answer
Get number of occurrences of substring case independent python
Python
1 vote156 views1 answer
Import mean squared log error
Python
0 vote167 views1 answer
How to delete all elements of a list in python
Python
0 vote149 views1 answer
How to display text on boxplot in python
Python
11 votes179 views3 answers
Reorder columns in python
Python
0 vote118 views1 answer
Dip programming language
Python