/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

57 votes333 views11 answers
Python print color
Python
-3 votes332 views1 answer
Buuya
Python
0 vote333 views1 answer
Cvtcoloer opencv
Python
0 vote377 views1 answer
Turn false true column into 0 1 pandas
Python
5 votes358 views3 answers
Print command python
Python
1 vote304 views1 answer
Reverse slice python
Python
1 vote352 views2 answers
Get current week python
Python
5 votes387 views2 answers
Python captcha
Python
0 vote377 views2 answers
Prevent division by zero numpy
Python
0 vote392 views1 answer
"must be called with either an object pk or a slug in the URLconf"
Python