/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

1 vote323 views1 answer
Rerun file after change python
Python
0 vote322 views1 answer
Django builtin signals
Python
0 vote333 views1 answer
Exec eval python
Python
0 vote307 views1 answer
Nlp = spacy.load('en') error
Python
15 votes364 views4 answers
Make a condition statement on column pandas
Python
0 vote365 views1 answer
Get opnly second part of multiindex
Python
1 vote291 views2 answers
Print hexadecimal in python
Python
0 vote367 views1 answer
Python unique values from pandas.series of sets
Python
1 vote332 views1 answer
Creating dictionary using the keys
Python
-1 vote284 views1 answer
Pip path windows 10
Python