/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

9 votes173 views4 answers
Convert float to integer pandas
Python
1 vote180 views1 answer
Unable to execute 'x86_64-linux-gnu-gcc': No such file or directoryunable to execute 'x86_64-linux-gnu-gcc': No such file or directory
Python
13 votes198 views5 answers
Convert column to numeric pandas
Python
8 votes170 views3 answers
Python split range into n groups
Python
0 vote189 views1 answer
Decode html python
Python
0 vote164 views1 answer
Dictionary multiple values per key
Python
1 vote169 views1 answer
Python add one
Python
14 votes158 views4 answers
Python convert dictionary to pandas dataframe
Python
1 vote176 views1 answer
Converting bool to 1 if it has true and if it is false print 1
Python
1 vote160 views1 answer
Make new app folder in django templates dir
Python