Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote234 views1 answer
Import get object
Python
0 vote315 views1 answer
Flask mongoengine getting started
Python Flask
2 votes251 views3 answers
Binary tree
Python
15 votes244 views2 answers
Insert string into middle of list python
Python
7 votes297 views2 answers
Randomly choose between two numbers python
Python
2 votes256 views1 answer
Color to black and white cv2
Python
0 vote262 views1 answer
Gizeh python
Python
0 vote305 views1 answer
Django extend user model
Python Django
0 vote277 views1 answer
PIL Make Circle
Python
0 vote296 views1 answer
Python webbrowser close tab
Python