/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

1 vote335 views1 answer
Replace space with . pyhton
Python
0 vote416 views1 answer
Response.url SSL warning python
Python
1 vote318 views1 answer
Como deixar todas as letras maiusculas no python
Python
16 votes348 views6 answers
Python raise exception
Python
0 vote332 views1 answer
Onehot encode list of columns pandas
Python
1 vote322 views1 answer
How to find python location in cmd
Python
0 vote322 views1 answer
Python string to list without split
Python
1 vote325 views2 answers
'Sequential' object has no attribute 'predict_classes'
Python
0 vote343 views1 answer
How to create a tuple from csv python
Python
2 votes334 views1 answer
Python check if character is letter
Python