Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote334 views1 answer
Plural name django
Python Django
0 vote268 views1 answer
Search bar using python
Python
10 votes303 views1 answer
Create dataframe with column names pandas
Python
-2 votes282 views4 answers
Django datepicker
Python
0 vote296 views1 answer
Mean absolute error percentage python
Python
16 votes294 views4 answers
Random.choice
Python
2 votes277 views1 answer
Continue vs pass python
Python
6 votes266 views2 answers
Numpy ones
Python
1 vote276 views1 answer
Numpy array heaviside float values to 0 or 1
Python
0 vote285 views1 answer
Show every second xtick
Python