/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote120 views1 answer
Transverse tensor in pytorch
Python
24 votes133 views3 answers
Get last n characters of string python
Python
0 vote110 views1 answer
Python display map
Python
1 vote108 views1 answer
Directly changing the fonts in the plotting file
Python
0 vote118 views1 answer
Python for loop get iteration number
Python
0 vote130 views1 answer
Dtype function with example
Python
21 votes116 views1 answer
Python today plus 1 day
Python
0 vote120 views1 answer
How to make python print 2 line text in one code
Python
0 vote106 views1 answer
How to get input from pyqt line edit
Python
0 vote117 views1 answer
Django create object with default today date
Python