/Python/Remove duplicate rows in csv file python

Remove duplicate rows in csv file python

# credit to the Stack Overflow user in the source link

with open('file_with_duplicates.csv','r') as in_file, open('ouput.csv','w') as out_file:
  
    seen = set() # set for fast O(1) amortized lookup
    
    for line in in_file:
        if line in seen: 
          continue # skip duplicate

        seen.add(line)
        out_file.write(line)

Source: stackoverflow.com

Similar codes

0 vote165 views1 answer
Ip address finder script python
Python
0 vote222 views1 answer
Pasar tupla a funcion python
Python
0 vote189 views2 answers
K7yKJk8vdjHvw56q7bCTxibvT
Python
1 vote191 views1 answer
Django ModelChoiceField value not id
Python Django
1 vote174 views1 answer
Vscode pylint missing module docstring
Python
7 votes189 views3 answers
Prettytable python
Python
0 vote176 views1 answer
How to send image to template thats not in static flask
Python
0 vote181 views1 answer
How to stop a program after 1 second in python
Python
0 vote185 views1 answer
Python discord.py hacking tool
Python
2 votes185 views2 answers
How to add element to list value in a dict python
Python