Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

31 votes318 views6 answers
Upgrade python version
Python
0 vote289 views1 answer
Add zero in front of numbers lower than 10 python
Python
2 votes321 views2 answers
How to show process bar in terminal python
Python
23 votes296 views2 answers
How to replace zero value in python dataframe
Python
0 vote302 views1 answer
Python list safely pop
Python
0 vote332 views1 answer
Python plot arrays from matrix
Python
1 vote321 views1 answer
Pandas read csv unamed:o
Python
3 votes317 views4 answers
Pair Plot Seaborn
Python
34 votes265 views4 answers
Confusion matrix python
Python
0 vote337 views1 answer
WARNING: Ignoring invalid distribution c program files python39libsite-packages
Python