/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote322 views1 answer
Loess dataframe
Python
0 vote310 views1 answer
Python csv find specific string
Python
51 votes293 views2 answers
How to search for an item in a list in python
Python
20 votes311 views3 answers
Python inline if
Python
0 vote295 views1 answer
Quoto x discord selfbot
Python
1 vote308 views1 answer
'set' object is not reversible
Python
1 vote311 views1 answer
Pip install qrcode python
Python
2 votes300 views1 answer
Get text from image python
Python
0 vote312 views1 answer
Python file hashlib
Python
10 votes328 views3 answers
Create a role with discord.py
Python