/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

-3 votes208 views1 answer
How to install chatterbot from github
Python
12 votes208 views5 answers
Django-cors-headers
Python Django
6 votes202 views1 answer
Get mouse postition python
Python
1 vote250 views1 answer
How to make an object set once python
Python
0 vote198 views1 answer
How to limit a command to a role in discord.py
Python
6 votes174 views2 answers
Numpy random int
Python
12 votes193 views3 answers
Python check if input is a number
Python
5 votes216 views3 answers
Python subplot space between plots
Python
3 votes193 views2 answers
Scikit learn lda
Python
0 vote180 views1 answer
Python open file same folder
Python