Python site-packages pyspark

import os

def myfun(x):`
        os.system("pip install shapely")
        return x
rdd = sc.parallelize([1,2,3,4]) ## assuming 4 worker nodes
rdd.map(lambda x: myfun(x)).collect() 
## call each cluster to run the code to import the library

Source: stackoverflow.com

Similar codes

0 vote167 views1 answer
Code to find the shape of the 2d list in python
Python
1 vote250 views1 answer
Django __str__ self multiple
Python Django
7 votes177 views2 answers
Python string to datetime python
Python
1 vote185 views1 answer
Numpy subarray python
Python
1 vote190 views1 answer
Import CSV Files into R Using read.csv() method
Python
0 vote166 views2 answers
Change value in excel using python
Python
0 vote175 views1 answer
Jointplot title
Python
2 votes170 views4 answers
Django login required
Python
0 vote190 views1 answer
How to drag a box on your screen python
Python
10 votes173 views3 answers
Replace nan with mean
Python