/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote268 views1 answer
Logout from linux using python
Python
1 vote293 views2 answers
Mp4 to mp3 in python
Python
1 vote294 views1 answer
For idx, col_name in enumerate(X_train.columns): print("The coefficient for {} is {}".format(file_name, regression_model.coef_[0][idx]))
Python
0 vote314 views1 answer
Django tempalte tag datetime to timestamp
Python
0 vote308 views1 answer
Abstract user in django
Python Django
2 votes244 views3 answers
Descending python dataframe df
Python
0 vote302 views1 answer
Qspinbox value changed
Python
40 votes285 views6 answers
Pandas sort columns by name
Python
0 vote275 views1 answer
Get os info in python
Python
5 votes268 views3 answers
Pygame quit
Python