/Python/Python delete duplicate lines in file

Python delete duplicate lines in file

with open("file.txt", "r") as txt_file:
  new_data = list(set(txt_file))
  return new_data

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote110 views1 answer
Python list inster 0
Python
1 vote161 views1 answer
Redirected but the response is missing a Location: header.
Python
0 vote112 views1 answer
Python change font in 1 line
Python
0 vote105 views1 answer
How to store something in python
Python
10 votes122 views3 answers
Set value based on column
Python
1 vote120 views1 answer
How to make a discord bot dm someone python
Python
0 vote109 views1 answer
Difference between end and sep python
Python
0 vote107 views1 answer
How to put 2 code n 1 line in python
Python
0 vote115 views1 answer
Pop element from heap python
Python
0 vote122 views1 answer
Python how to acquire the html code for a website
Python