/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote266 views12 answers
Installez django-cruds-adminlte
Python Django
0 vote291 views1 answer
Features and image recongnition
Python
0 vote287 views1 answer
How to run shell command ctrl + c in python script
Python
4 votes338 views1 answer
Python code to drop columns from dataframe
Python
1 vote300 views1 answer
How to make a breakable loop in python
Python
0 vote294 views1 answer
Django test imagefield
Python
0 vote303 views1 answer
Django test postgres extensions intarray
Python
19 votes308 views1 answer
Python cut string to length
Python
0 vote276 views5 answers
Space weather dashboard build your own custom dashboard to analyze and predict weather
Python
18 votes320 views6 answers
Install Django Windows
Python