/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

1 vote184 views1 answer
Max string length python
Python
0 vote192 views1 answer
Reorder list python
Python
1 vote192 views1 answer
Directly changing the fonts in the plotting file
Python
0 vote195 views1 answer
Change command aliad
Python
-4 votes195 views5 answers
Python 3.5 release date
Python
0 vote192 views4 answers
Randome Word generator from consonant, vowel and specific string
Python
0 vote185 views1 answer
Python playsound stop
Python
1 vote189 views1 answer
Split string form url last slash
Python
29 votes193 views6 answers
Count unique values pandas
Python
1 vote215 views1 answer
Django get form id from request
Python Django