Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote276 views1 answer
Getting Random rows in dataframe
Python
1 vote304 views1 answer
Python convert number in array to integer
Python
0 vote252 views2 answers
Pandas groupby aggregate quantile
Python
3 votes267 views1 answer
Python procedured
Python
2 votes305 views1 answer
Convert int to byte python
Python
0 vote288 views1 answer
Python change type of every element in a dictionary
Python
25 votes440 views3 answers
Startapp django
Python Django
0 vote354 views1 answer
Split list in half python
Python
0 vote275 views1 answer
Algorithme permettant de passer au negatif une image
Python
1 vote278 views1 answer
Strptime python decimal seconds
Python