/Python/Save this RDD as a SequenceFile of serialized objects

Save this RDD as a SequenceFile of serialized objects

tmpFile = NamedTemporaryFile(delete=True)
tmpFile.close()
sc.parallelize([1, 2, 'spark', 'rdd']).saveAsPickleFile(tmpFile.name, 3)
sorted(sc.saveAsPickleFile(tmpFile.name, 5).map(str).collect())
# ['1', '2', 'rdd', 'spark']

Source: spark.apache.org

Similar codes

2 votes346 views1 answer
Flask import jsonify
Python Flask
0 vote302 views1 answer
How to run shell command ctrl + c in python script
Python
10 votes322 views2 answers
Convert hex to decimal python
Python
16 votes327 views6 answers
Django model
Python
0 vote318 views1 answer
Pyqt5 close event
Python
0 vote328 views1 answer
Lowering the time.countdown python
Python
0 vote329 views1 answer
Binary table dataframe
Python
1 vote340 views1 answer
Python get last element of iterator
Python
0 vote298 views2 answers
Get script text selenium python
Python
-1 vote278 views1 answer
For enumerate start from 1 python
Python