/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote247 views1 answer
Subprocess ffmpeg x265 codec
Python
0 vote243 views1 answer
Sequence with numbers in python
Python
1 vote211 views1 answer
Beautiful soup how to extract from webpage
Python
1 vote234 views6 answers
How to hello world in python
Python
0 vote245 views1 answer
Find allurl in text python
Python
0 vote233 views1 answer
Name 'plt' is not defined
Python
-1 vote235 views2 answers
Python choose function
Python
1 vote237 views1 answer
Why is there a lot of numbers in python
Python
0 vote275 views1 answer
Pytorchvideo stack expects each tensor to be equal size, but got [89088] at entry 0 and [88064] at entry 1
Python
0 vote231 views2 answers
Python sort a list using defined order
Python