/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote177 views1 answer
Ascii tables in python
Python
4 votes252 views2 answers
How to make never ending program in python
Python
0 vote181 views1 answer
List of python keywords
Python
6 votes180 views1 answer
Selectfield flask wtf
Python
1 vote185 views1 answer
Import CSV Files into R Using fread() method
Python
1 vote189 views2 answers
How to connect ip camera to opencv python
Python
1 vote170 views2 answers
Remove 1st column pandas
Python
0 vote163 views1 answer
Dataframe to ftp
Python
1 vote176 views3 answers
Django logout user
Python
0 vote165 views1 answer
How to make text bold in tkinter
Python