/Python/Build the union of a list of RDDs

Build the union of a list of RDDs

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Source: spark.apache.org

Similar codes

0 vote302 views2 answers
Youtube net worth
Python
7 votes344 views1 answer
How to find where python is located
Python
0 vote335 views1 answer
How to deploy to heroku djangorest framework app
Python
2 votes347 views2 answers
HBox(children=(FloatProgress(value=
Python
0 vote378 views1 answer
Area of a right angle triangle in python
Python
2 votes339 views2 answers
Python format 001
Python
0 vote331 views1 answer
Regex_2/_regex.c:50:10: fatal error: Python.h: No such file or directory
Python
12 votes328 views3 answers
How to open any application using python
Python
100 votes308 views6 answers
Pip3 upgrade
Python
1 vote309 views1 answer
Check if coroutine python
Python