/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

1 vote199 views1 answer
Pandas row from dict
Python
0 vote187 views1 answer
Can't open file 'sherlock.py' errno 2 no such file or directory
Python
0 vote185 views1 answer
Python pandas how to select range of data
Python
0 vote204 views1 answer
Get panda df as a string csv
Python
1 vote193 views1 answer
Add element to heap python
Python
0 vote207 views1 answer
How to modify name of email from divi
Python
9 votes192 views1 answer
Json encode in python
Python
-1 vote188 views1 answer
Pseudocode examples for beginners
Python
0 vote217 views1 answer
Django python base 64 encode
Python Django
5 votes198 views1 answer
What is seaborn in python
Python