/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

-1 vote347 views1 answer
S = 0 for x in seq: s += x
Python
0 vote346 views1 answer
How to separate year from datetime column in python
Python
5 votes399 views4 answers
Discord.py find channel by id
Python
0 vote354 views1 answer
Python get unicode spaces
Python
0 vote350 views1 answer
Pyspark rdd method
Python
-2 votes423 views1 answer
How to get data from django session
Python Django
0 vote385 views1 answer
Fetch json array from mysql django
Python
-1 vote331 views1 answer
Uninstall python kali linux
Python
40 votes356 views4 answers
Python datetime module
Python
2 votes337 views2 answers
Pdf to csv python
Python