/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

1 vote328 views2 answers
React icon size
Python
2 votes311 views1 answer
How to add captcha in django forms
Python
2 votes300 views2 answers
Django search
Python
17 votes309 views4 answers
Pip install python 3
Python
8 votes309 views6 answers
Calculator in python
Python
-2 votes303 views1 answer
Does python pass by reference
Python
0 vote327 views1 answer
Django add queury parameters to reverse
Python
0 vote382 views2 answers
Plt.xlabel not working
Python
0 vote285 views1 answer
Python for comparing url path
Python
12 votes332 views6 answers
How to make a list in python
Python