/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote333 views1 answer
Ax text relative coordinates
Python
0 vote315 views1 answer
Search bar using python
Python
1 vote326 views4 answers
Bogo Sort
Python
3 votes340 views1 answer
Convert epoch to date time in python
Python
8 votes325 views1 answer
Python transfer file
Python
1 vote331 views1 answer
Sparse categorical cross entropy python
Python
0 vote326 views1 answer
Pandas csv sum column
Python
0 vote328 views1 answer
Chromebook install pip
Python
1 vote410 views2 answers
All column except pandas
Python
0 vote340 views1 answer
How to make text change lines pygame
Python