/Python/Pyspark check all columns for null values

Pyspark check all columns for null values

from pyspark.sql.functions import isnan, when, count, col

df.select([count(when(isnan(c), c)).alias(c) for c in df.columns]).show()
+-------+----------+---+
|session|timestamp1|id2|
+-------+----------+---+
|      0|         0|  3|
+-------+----------+---+

Source: stackoverflow.com

Similar codes

0 vote278 views2 answers
Python difference between multiprocessing Pool and Threadpool
Python
0 vote278 views1 answer
Pytorch rolling window
Python
8 votes265 views2 answers
Determinant of a matrix in python
Python
18 votes275 views4 answers
Matplotlib histogram
Python
0 vote279 views3 answers
System.Windows.Forms.DataGridView.CurrentRow.get returned null. c#
Python
1 vote300 views1 answer
Create 2d list dictionary
Python
18 votes262 views4 answers
Create a venv
Python
-1 vote276 views1 answer
With urllib.request.urlopen("https://
Python
0 vote273 views1 answer
For i in array in range python
Python
0 vote281 views1 answer
How to make a numpy array of certain values
Python