Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote107 views1 answer
Python edit global variable in function
Python
0 vote140 views1 answer
Delete history django simple
Python Django
114 votes112 views6 answers
Python print to file
Python
0 vote120 views1 answer
./bootstrap command not found in dockerfile
Python
0 vote112 views1 answer
How to create enter pressed for qlineedit in pyqt5
Python
6 votes107 views3 answers
Np random seed
Python
3 votes109 views6 answers
Python variable
Python
0 vote157 views1 answer
Make the program title a name python
Python
24 votes125 views4 answers
Select rows which have nan values python
Python
0 vote133 views1 answer
Django how to create superuser if does not exists on migration
Python Django