/Python/Save this RDD as a SequenceFile of serialized objects

Save this RDD as a SequenceFile of serialized objects

tmpFile = NamedTemporaryFile(delete=True)
tmpFile.close()
sc.parallelize([1, 2, 'spark', 'rdd']).saveAsPickleFile(tmpFile.name, 3)
sorted(sc.saveAsPickleFile(tmpFile.name, 5).map(str).collect())
# ['1', '2', 'rdd', 'spark']

Source: spark.apache.org

Similar codes

0 vote242 views1 answer
Close all tables python
Python
0 vote266 views1 answer
Command run test keep db python
Python
0 vote281 views1 answer
Discertize dara python
Python
15 votes292 views3 answers
Python get lan ip
Python
34 votes294 views3 answers
How to run bash script in python
Python
0 vote349 views1 answer
Python print f
Python
1 vote243 views1 answer
Da
Python
0 vote276 views1 answer
Boolien in python
Python
1 vote256 views1 answer
Anaconda install requests
Python
-1 vote320 views2 answers
Django connection cursor
Python