/Python/Python remove duplicates from list of dict

Python remove duplicates from list of dict

Python remove repeated elements from list

# ----- Create a list with no repeating elements ------ #

mylist = [67, 7, 89, 7, 2, 7]
newlist = []

  for i in mylist: 
    if i not in newlist: 
        newlist.append(i)

Python dict remove duplicates where name are not the same

import itertools
mylist = [{'x':2020 , 'y':20},{'x':2020 , 'y':30},{'x':2021 , 'y':10},{'x':2021 , 'y':5}]
mylist1=[]
for key, group in itertools.groupby(mylist,lambda x:x["x"]):
    max_y=0
    for thing in group:
        max_y=max(max_y,thing["y"])
    mylist1.append({"x":key,"y":max_y})
print(mylist1)

Source: stackoverflow.com

Python remove duplicates from list of dict

# set the dict to a tuple for hashability, then use {} for set literal and retrn each item to dict. 
[dict(t) for t in {tuple(d.items()) for d in l}]
# using two maps()
list(map(lambda t: dict(t), set(list(map(lambda d: tuple(d.items()), l)))))

-1

Source: stackoverflow.com

Similar codes

0 vote351 views1 answer
Python filter function using lambda function as one of the parameters
Python
6 votes346 views3 answers
Python program to get the file size of a plain file.
Python
1 vote297 views1 answer
Why is python so popular
Python
0 vote313 views1 answer
Pandas check match string lowercase
Python
22 votes333 views4 answers
No module named 'sklearn.cross_validation'
Python
0 vote346 views1 answer
Read .fasta python
Python
0 vote307 views1 answer
Save_img keras
Python
2 votes313 views2 answers
Python dataframe get numeric columns
Python
81 votes320 views6 answers
Python write to file
Python
52 votes312 views6 answers
Python virtual enviroment
Python