/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

16 votes344 views4 answers
Python remove last instance of a list
Python
0 vote307 views1 answer
Fnd closest element in array numpy
Python
0 vote367 views1 answer
Ticklabels are not centered heatmap
Python
0 vote301 views9 answers
Filter dataframe site:stackoverflow.com
Python
0 vote321 views1 answer
How to save a python object in a file
Python
0 vote317 views1 answer
Python no label in legend matplot
Python
0 vote298 views1 answer
Pip neat
Python
1 vote315 views1 answer
Find index of max value in 2d array python
Python
7 votes307 views3 answers
Python pattern match
Python
-1 vote312 views1 answer
How to bubble sort a 2d array in python
Python