/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

3 votes191 views1 answer
Read tsv file column
Python
0 vote197 views1 answer
Sum values in django models and insert value in model field
Python
11 votes197 views3 answers
Username Python
Python
0 vote215 views1 answer
Split the string using the separator
Python
0 vote229 views1 answer
Replace string if it contains a substring pandas
Python
0 vote251 views1 answer
How to return Fibbonaci(n) python
Python
4 votes204 views2 answers
Difference between two dictionaries python
Python
1 vote247 views1 answer
Model evaluate function
Python
1 vote192 views1 answer
Convert array to set python
Python
0 vote214 views1 answer
F-string print
Python