/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

7 votes212 views1 answer
Python xrange
Python
0 vote227 views1 answer
To run python script in terminal i want to type python insted of python3
Python
0 vote218 views1 answer
Ipywidgets label text color
Python
9 votes211 views1 answer
Json encode in python
Python
0 vote197 views1 answer
Reddit python 3 time a python program
Python
6 votes209 views2 answers
Scatter plot plotly
Python
0 vote218 views1 answer
Replace string using regex
Python
1 vote227 views2 answers
What is a cube plus b cube
Python
0 vote210 views1 answer
Check if key exists in sesson python flask
Python
0 vote239 views1 answer
Python get how many days in current month
Python