/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

3 votes293 views3 answers
Quadratic equation
Python
8 votes339 views6 answers
Pandas remove outliers
Python
0 vote304 views1 answer
EXCEL , EXTRAER DELIMITADOR
Python
0 vote308 views1 answer
Pandas insert a list into cell
Python
0 vote311 views1 answer
!python read data from mysql and export to xecel
Python
0 vote308 views2 answers
Python send image server
Python
7 votes323 views2 answers
Find max length of list of list python
Python
0 vote298 views1 answer
Cudf - merge dataframes
Python
0 vote328 views1 answer
Sonido sfr200a
Python
0 vote345 views1 answer
Ordered set
Python