/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

2 votes319 views1 answer
Python typing as int or float
Python
0 vote370 views1 answer
Django validate_comma_separated_integer_list
Python Django
0 vote297 views1 answer
Python shortest distance between two points
Python
7 votes334 views2 answers
How to generate requirements.txt django
Python
51 votes351 views6 answers
Pandas reorder columns
Python
0 vote301 views1 answer
Python replace list of ips from yaml file with new list
Python
0 vote326 views2 answers
Binary Search tree implementation in python
Python
-1 vote328 views2 answers
How to url encode using python django
Python
0 vote353 views4 answers
Online python to c++ compiler
Python
0 vote292 views1 answer
Nltk regex parser
Python