/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote324 views1 answer
Ubuntu download file command line
Python
2 votes303 views1 answer
Python version command notebook
Python
0 vote299 views1 answer
Add variable to print python
Python
1 vote279 views1 answer
Install xgboost
Python
8 votes281 views2 answers
How to break a list unequal size chunks in python
Python
2 votes284 views2 answers
Check if boolean is true python
Python
0 vote304 views2 answers
How to read specific words from a file in python
Python
0 vote283 views1 answer
Aiohttp get
Python
0 vote333 views1 answer
ConversionofDatatypes-I
Python
0 vote279 views1 answer
Json decode py
Python