/Python/Reduces the elements of this RDD using the specified commutative and associative binary operator

Reduces the elements of this RDD using the specified commutative and associative binary operator

from operator import add
sc.parallelize([1, 2, 3, 4, 5]).reduce(add)
# 15
sc.parallelize((2 for _ in range(10))).map(lambda x: 1).cache().reduce(add)
# 10
sc.parallelize([]).reduce(add)
"""
Traceback (most recent call last):
    ...
ValueError: Can not reduce() empty RDD
"""

Source: spark.apache.org

Similar codes

0 vote265 views1 answer
Display full length jupyter
Python
2 votes270 views2 answers
Conda create jupyter kernel
Python
0 vote247 views1 answer
Python logging basicConfig+time
Python
24 votes260 views2 answers
Python timedelta
Python
1 vote251 views1 answer
Pycharm remove not in use imports
Python
0 vote249 views1 answer
Filter nulla values only pandas
Python
0 vote280 views2 answers
Check if a value is in index pandas dataframe
Python
1 vote286 views1 answer
Python requests.get timeout
Python
39 votes260 views6 answers
How to use a class in python
Python
8 votes257 views4 answers
Python zip folder
Python