Python site-packages pyspark

import os

def myfun(x):`
        os.system("pip install shapely")
        return x
rdd = sc.parallelize([1,2,3,4]) ## assuming 4 worker nodes
rdd.map(lambda x: myfun(x)).collect() 
## call each cluster to run the code to import the library

Source: stackoverflow.com

Similar codes

0 vote180 views1 answer
Django model meta ordering multiple ordering
Python Django
17 votes165 views4 answers
Get ip address python
Python
2 votes195 views3 answers
How to set indian timezone in django
Python Django
2 votes178 views3 answers
How to set default python version linux
Python
5 votes158 views2 answers
Matplotlib axes labels
Python
0 vote242 views4 answers
"%(class)s" in django
Python Django
1 vote180 views1 answer
Python clamp
Python
1 vote150 views1 answer
How to select python 3 interpreter in linux
Python
26 votes165 views4 answers
Python send email with attachment
Python
17 votes203 views5 answers
Python add element to array
Python