/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote340 views1 answer
How to colour letters in python
Python
1 vote323 views1 answer
Python psycopg2 utf8
Python
2 votes366 views2 answers
Create django user command line
Python Django
0 vote344 views1 answer
Del(list) python
Python
1 vote337 views1 answer
Python oprators
Python
0 vote345 views2 answers
Identity matrix with numpy
Python
2 votes337 views4 answers
Pandas fillna with mode
Python
2 votes358 views2 answers
Pandas categorical dtypes
Python
0 vote308 views1 answer
How to make a username system using python
Python
0 vote345 views1 answer
Solving fastapi error > assert message["type"] == "http.response.start"
Python