/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote370 views1 answer
Django.db.backends.mysql install
Python Django
1 vote309 views1 answer
Write a python program to split a given dictionary of lists into list of dictionaries.
Python
0 vote367 views1 answer
Renomear colunas pandas
Python
16 votes352 views1 answer
Python reload function in shell
Python
7 votes355 views4 answers
Create dict from two columns pandas
Python
0 vote365 views1 answer
Divide a column value in pandas dataframe
Python
1 vote395 views1 answer
How to redirect to previous page in django
Python Django
0 vote359 views1 answer
How do i add new items to a dictionary within a for loop python
Python
6 votes383 views3 answers
Flask get ip of user
Python Flask
1 vote393 views1 answer
Numpy series reset index
Python