/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote210 views1 answer
Neutral
Python
1 vote251 views1 answer
Fourreau de maroquin
Python
4 votes231 views2 answers
Python dump object print
Python
0 vote218 views1 answer
ModuleNotFoundError: No module named 'boto3'
Python
4 votes217 views1 answer
Df.sort_values(by='col1',asending=True)
Python
19 votes225 views2 answers
Set background colour tkinter
Python
24 votes214 views1 answer
Print type(x) in python
Python
1 vote223 views2 answers
Python listen to keyboard input linux
Python
0 vote228 views1 answer
Python apply function to list
Python
1 vote236 views1 answer
Python - count values that contain special characters
Python