/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote215 views1 answer
Create a queryset list django
Python
2 votes266 views2 answers
Or in django query
Python
0 vote269 views1 answer
How to set pywal permenent
Python
19 votes262 views5 answers
Save matplotlib figure
Python
0 vote277 views1 answer
Add one element to tuple python
Python
4 votes257 views1 answer
How to save a neural network pytorch
Python
1 vote287 views1 answer
Get text from url python last slash
Python
0 vote267 views1 answer
Isenable selenium python
Python
0 vote277 views1 answer
Tkinter include svg in script
Python
0 vote304 views1 answer
Python - Modify Strings
Python