Python site-packages pyspark

import os

def myfun(x):`
        os.system("pip install shapely")
        return x
rdd = sc.parallelize([1,2,3,4]) ## assuming 4 worker nodes
rdd.map(lambda x: myfun(x)).collect() 
## call each cluster to run the code to import the library

Source: stackoverflow.com

Similar codes

0 vote302 views1 answer
Python random phone number
Python
2 votes272 views2 answers
Python url join
Python
-2 votes310 views2 answers
Django form date picker
Python Django
0 vote334 views1 answer
Pyspark name accumulator
Python
0 vote272 views1 answer
How to run python on ios
Python
13 votes291 views2 answers
Get start time and end time in python
Python
0 vote371 views1 answer
Django month name from month number
Python Django
0 vote269 views1 answer
Python uml
Python
43 votes283 views5 answers
Import sklearn
Python
0 vote283 views1 answer
Python print error output
Python