/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote144 views1 answer
Python get operating system name
Python
0 vote113 views1 answer
Matplotlib subplots share x axis
Python
1 vote107 views1 answer
Spress warnings selenium python
Python
-1 vote112 views1 answer
Receipt ocr
Python
17 votes108 views2 answers
How to learn python
Python
0 vote108 views1 answer
How to find left top width and height on an image using python
Python
0 vote154 views1 answer
RuntimeError: cannot open featureclass in python
Python
4 votes113 views1 answer
Concat dataframe from list of dataframe
Python
1 vote105 views1 answer
How to scroll down to end of page in selenium python
Python
0 vote104 views1 answer
Debug console shows blank
Python