Pandas remove outliers

Remove outliers python pandas

#------------------------------------------------------------------------------
# accept a dataframe, remove outliers, return cleaned data in a new dataframe
# see http://www.itl.nist.gov/div898/handbook/prc/section1/prc16.htm
#------------------------------------------------------------------------------
def remove_outlier(df_in, col_name):
    q1 = df_in[col_name].quantile(0.25)
    q3 = df_in[col_name].quantile(0.75)
    iqr = q3-q1 #Interquartile range
    fence_low  = q1-1.5*iqr
    fence_high = q3+1.5*iqr
    df_out = df_in.loc[(df_in[col_name] > fence_low) & (df_in[col_name] < fence_high)]
    return df_out

Source: stackoverflow.com

Delete outliers in pandas

cols = ['col_1', 'col_2'] # one or more

Q1 = df[cols].quantile(0.25)
Q3 = df[cols].quantile(0.75)
IQR = Q3 - Q1

df = df[~((df[cols] < (Q1 - 1.5 * IQR)) |(df[cols] > (Q3 + 1.5 * IQR))).any(axis=1)]

Source: stackoverflow.com

Remove outliers python dataframe

cols = ['col_1', 'col_2'] # one or more

Q1 = df[cols].quantile(0.25)
Q3 = df[cols].quantile(0.75)
IQR = Q3 - Q1

df = df[~((df[cols] < (Q1 - 1.5 * IQR)) |(df[cols] > (Q3 + 1.5 * IQR))).any(axis=1)]

Source: stackoverflow.com

Outliers removal pandas

df = pd.DataFrame(np.random.randn(100, 3))

from scipy import stats
df[(np.abs(stats.zscore(df)) < 3).all(axis=1)]

Source: stackoverflow.com

Pandas remove outliers

df = pd.DataFrame(np.random.randn(100, 3))

from scipy import stats
df[(np.abs(stats.zscore(df)) < 3).all(axis=1)]

Source: stackoverflow.com

Pandas removing outliers from dataframe

df[(df["col"] >= x ) & (df["col"] <= y )]

but it's more readable to use:

df[df["col"].between(x,y)]

Source: app.dataquest.io

Similar codes

0 vote118 views1 answer
Machine learning project outline
Python
15 votes106 views3 answers
How to import numpy in python
Python
2 votes106 views1 answer
Father's day 2020
Python
0 vote113 views1 answer
Set lable of field django
Python
0 vote106 views1 answer
How to import api keys
Python
34 votes108 views3 answers
Download dataframe as csv
Python
1 vote111 views1 answer
Cprofile usage python
Python
51 votes152 views6 answers
Pandas reorder columns
Python
1 vote108 views1 answer
How to change the rate of speech in pyttsx3
Python
0 vote105 views1 answer
Python print file content
Python