/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

2 votes253 views1 answer
How to make otp generator in python
Python
4 votes280 views2 answers
Django queryset group by
Python
3 votes280 views2 answers
Python multiply list by scalar
Python
2 votes271 views2 answers
Tkinter treeview
Python
3 votes280 views2 answers
Getting text input pygame python
Python
0 vote271 views1 answer
Quote_from_bytes() expected bytes
Python
1 vote244 views2 answers
Correlation between two columns pandas
Python
5 votes279 views2 answers
Use selenium without opening browser
Python
7 votes257 views2 answers
How to get something from a certian possition in a list python
Python
0 vote239 views1 answer
Initiate dask
Python