/Python/Group the values for each key in the RDD into a single sequence.

Group the values for each key in the RDD into a single sequence.

rdd = sc.parallelize([("a", 1), ("b", 1), ("a", 1)])
sorted(rdd.groupByKey().mapValues(len).collect())
# [('a', 2), ('b', 1)]
sorted(rdd.groupByKey().mapValues(list).collect())
# [('a', [1, 1]), ('b', [1])]

Source: spark.apache.org

Similar codes

8 votes254 views4 answers
ModuleNotFoundError: No module named 'pandas'
Python
0 vote296 views1 answer
Extract filename from path in Python
Python
2 votes255 views1 answer
Python argparser flags
Python
8 votes291 views2 answers
Django create empty migration
Python Django
0 vote262 views2 answers
Scrapy capture: Error downloading
Python
1 vote268 views1 answer
Discord.py message user
Python
1 vote280 views1 answer
Python get last item in a list
Python
0 vote288 views1 answer
No python application found, check your startup logs for errors
Python
1 vote271 views1 answer
Django sites framework
Python Django
0 vote297 views1 answer
Raise TypeError('expected ' + str(self.expected_type)) TypeError: expected <class 'openpyxl.styles.colors.Color'>
Python