/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote351 views2 answers
Python bytes to dict
Python
4 votes342 views1 answer
Pandas transpose
Python
3 votes326 views3 answers
Quadratic equation
Python
14 votes382 views3 answers
Pillow image from array
Python
0 vote349 views1 answer
Python cut string after character
Python
1 vote320 views1 answer
Split dict into chunks python
Python
0 vote357 views1 answer
Historicaltickbidask
Python
1 vote347 views1 answer
How to use arjun tool
Python
7 votes342 views3 answers
Prettytable python
Python
1 vote345 views1 answer
Python seconds counter
Python