/Python/Save this RDD as a SequenceFile of serialized objects

Save this RDD as a SequenceFile of serialized objects

tmpFile = NamedTemporaryFile(delete=True)
tmpFile.close()
sc.parallelize([1, 2, 'spark', 'rdd']).saveAsPickleFile(tmpFile.name, 3)
sorted(sc.saveAsPickleFile(tmpFile.name, 5).map(str).collect())
# ['1', '2', 'rdd', 'spark']

Source: spark.apache.org

Similar codes

0 vote244 views1 answer
How to make game on python
Python
0 vote230 views1 answer
How to extract numbers from a list in python
Python
7 votes240 views1 answer
How to set the screen brightness using python
Python
0 vote228 views1 answer
Accuracy for each class
Python
2 votes208 views1 answer
Download youtube videos using api python
Python
-1 vote236 views3 answers
Try using .loc[row_indexer,col_indexer] = value instead
Python
4 votes212 views6 answers
Python variables
Python
1 vote218 views1 answer
Wrap list python
Python
10 votes224 views3 answers
Add picture to jupyter notebook
Python
-1 vote243 views1 answer
Converting multipage tiff to pdf python
Python