/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

1 vote319 views1 answer
Look through dict
Python
0 vote323 views1 answer
Convert exception to string python
Python
7 votes327 views3 answers
Get char of string python
Python
0 vote330 views1 answer
Python execute echo to file
Python
0 vote390 views1 answer
Set value through serializer django
Python Django
2 votes329 views1 answer
Code for dimensions in numpy
Python
1 vote343 views1 answer
Python nested tqdm
Python
0 vote330 views1 answer
Python - find columns that are objects
Python
0 vote371 views1 answer
How to count the appearance of number or string in a list python
Python
225 votes607 views6 answers
Random number generator python
Python