/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

1 vote279 views1 answer
How to set up dataframe from csv
Python
0 vote313 views1 answer
Python invert colormap
Python
24 votes272 views5 answers
Get time python
Python
10 votes262 views3 answers
Matplotlib axis labels
Python
0 vote265 views1 answer
Save_img keras
Python
0 vote314 views1 answer
Matplotlib bar chart from dictionary
Python
3 votes278 views2 answers
Map dataframe
Python
32 votes275 views3 answers
Python create new folder in path that don't exist
Python
0 vote263 views1 answer
String acharacters count in python without using len
Python
23 votes293 views6 answers
Flask post
Python