Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

22 votes260 views2 answers
Reset_index(drop=true)
Python
2 votes252 views1 answer
What does % do in python
Python
6 votes240 views1 answer
Save and load a dictionary python
Python
1 vote260 views1 answer
Python update multiple dictionary values
Python
0 vote247 views1 answer
Saaaaaaaaaaaaa
Python
13 votes281 views2 answers
How to get last letter of string python
Python
0 vote292 views1 answer
Lose your django secret key
Python Django
7 votes275 views6 answers
Python random word
Python
1 vote288 views1 answer
Python alphabet to number
Python
0 vote271 views1 answer
Flask python use specified port
Python