/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote228 views1 answer
Statsmodels fitted values
Python
0 vote205 views1 answer
How to subtract up everything in a list python
Python
0 vote240 views1 answer
Dictionary Get All Keys
Python
0 vote216 views1 answer
Django queryset to instance
Python
0 vote282 views1 answer
Python REPL loop
Python
1 vote248 views1 answer
Set icon title tkinter
Python
7 votes245 views6 answers
Dictionary comprehension python
Python
0 vote264 views1 answer
Mysql.connector.errors.InterfaceError: Failed executing the operation; Not all parameters were used in the SQL statement
Python
0 vote261 views1 answer
Creating base models django
Python
0 vote226 views1 answer
Python get file ending
Python