Python site-packages pyspark

import os

def myfun(x):`
        os.system("pip install shapely")
        return x
rdd = sc.parallelize([1,2,3,4]) ## assuming 4 worker nodes
rdd.map(lambda x: myfun(x)).collect() 
## call each cluster to run the code to import the library

Source: stackoverflow.com

Similar codes

0 vote104 views1 answer
F readlines python not working
Python
0 vote104 views1 answer
Subtract from dataframe
Python
0 vote105 views1 answer
Pandas groupby without reset index
Python
0 vote109 views1 answer
Python bangla packages
Python
4 votes163 views1 answer
Python 3.7 download for windows 7 32-bit
Python
0 vote107 views1 answer
Find allurl in text python
Python
8 votes93 views3 answers
Linear search python
Python
7 votes119 views3 answers
Subtract list from list python
Python
1 vote110 views2 answers
Add item to tuple
Python
0 vote105 views1 answer
Create database tables python
Python