/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

2 votes231 views1 answer
Fromkeys in python
Python
236 votes461 views6 answers
Import random in python
Python
0 vote184 views1 answer
Python how to hash string into pbkdf2
Python
0 vote243 views1 answer
Python ordereddict reverse
Python
10 votes218 views3 answers
Tkinter window title
Python
8 votes219 views6 answers
Python get numbers from string
Python
1 vote241 views1 answer
Choromap = go.Figure(data=[data], layout = layout)
Python
0 vote202 views1 answer
Pandas print a single row
Python
3 votes219 views1 answer
How to change window size in kivy python
Python
1 vote232 views1 answer
Deleting all rows in pandas
Python