/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

4 votes309 views1 answer
How to delete every row in excel using openpyxl
Python
1 vote315 views1 answer
Droaw heat map in python for null values
Python
1 vote280 views2 answers
Python csv reader skip header
Python
11 votes305 views2 answers
Pandas shuffle rows
Python
4 votes290 views1 answer
How to check opencv version using python
Python
0 vote332 views1 answer
Django jinja else if template tags
Python Django
0 vote291 views1 answer
OneHotEncoder(categorical_features=
Python
2 votes313 views2 answers
Pandas create column from another column
Python
0 vote291 views1 answer
Duplicate a list with for loop in python
Python
0 vote297 views1 answer
Anaconda-navigator command not found
Python