Nan vs nat pandas

Count nan pandas

#Python, pandas
#Count missing values for each column of the dataframe df

df.isnull().sum()

Source: thispointer.com

Pandas nan values in column

df['your column name'].isnull()

Nan vs nat pandas

>>> import pandas as pd, datetime, numpy as np
>>> df = pd.DataFrame({'a': [datetime.datetime.now(), np.nan], 'b': [5, np.nan], 'c': [1, 2]})
>>> df
                           a    b  c
0 2019-02-17 18:06:15.231557  5.0  1
1                        NaT  NaN  2
>>> fill_dt = datetime.datetime.now()
>>> fill_value = 4
>>> dt_filled_df = df.select_dtypes('datetime').fillna(fill_dt)
>>> dt_filled_df
                           a
0 2019-02-17 18:06:15.231557
1 2019-02-17 18:06:36.040404
>>> value_filled_df = df.select_dtypes('int').fillna(fill_value)
>>> value_filled_df
   c
0  1
1  2
>>> dt_filled_df.columns = [col + '_notnull' for col in dt_filled_df]
>>> value_filled_df.columns = [col + '_notnull' for col in value_filled_df]
>>> df = df.join(value_filled_df)
>>> df = df.join(dt_filled_df)
>>> df
                           a    b  c  c_notnull                  a_notnull
0 2019-02-17 18:06:15.231557  5.0  1          1 2019-02-17 18:06:15.231557
1                        NaT  NaN  2          2 2019-02-17 18:06:36.040404

Source: stackoverflow.com

Similar codes

17 votes269 views4 answers
How to check how many items are in a list python
Python
12 votes245 views6 answers
Python convert date to timestamp
Python
0 vote284 views1 answer
Django form set min and max value
Python Django
8 votes257 views4 answers
How to calculate the age from date of birth in python
Python
0 vote238 views1 answer
Python - remove floating in a dataframe
Python
4 votes250 views2 answers
Python exception with line number
Python
1 vote237 views2 answers
Pandas merge two columns from different dataframes
Python
2 votes233 views1 answer
Unsigned int python
Python
3 votes222 views1 answer
Tick labels vertical matplotlib
Python
0 vote247 views1 answer
Oversampling using smote
Python