/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote261 views1 answer
Qtile: latest development version
Python
0 vote234 views1 answer
Blank lines with csv.writer
Python
1 vote224 views1 answer
Reverse row order pandas
Python
0 vote226 views1 answer
MASS algorithm python
Python
21 votes236 views6 answers
Install pygame
Python
0 vote239 views2 answers
User logout in django rest framework
Python
5 votes223 views1 answer
Get request body flask
Python
57 votes234 views4 answers
Get date and time in python
Python
1 vote230 views1 answer
Using-len-for-text-but-discarding-spaces-in-the-count
Python
1 vote225 views1 answer
How to find the most similar word in a list in python
Python