/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

1 vote309 views5 answers
Filter function in python
Python
0 vote247 views1 answer
What is tf.repeat()
Python
0 vote239 views1 answer
What is a rare earth
Python
3 votes245 views2 answers
Pandas df row count
Python
57 votes238 views3 answers
Python interpreter clear screen
Python
1 vote252 views1 answer
TypeError: ‘int’ object is not subscriptable Solution
Python
1 vote253 views1 answer
Set up and run a two-sample independent t-test
Python
0 vote257 views1 answer
Struct trong python
Python
0 vote245 views1 answer
Python list inster 0
Python
4 votes292 views2 answers
Online pygame compiler with sprites
Python