Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote217 views1 answer
Find the place of element in list python
Python
2 votes216 views1 answer
Get distance between 2 multidimentional point in python
Python
0 vote206 views1 answer
How many handshakes for all the people in your class? python code
Python
0 vote213 views1 answer
Equivalent of case_when in r in pandas
Python
0 vote216 views1 answer
Apps to help in coding python exmas
Python
26 votes247 views8 answers
Corona
Python
0 vote214 views1 answer
How to add a file to an email in python
Python
0 vote236 views2 answers
Discord.py get channel id by channel name
Python
0 vote213 views1 answer
How to install python dill
Python
9 votes224 views2 answers
Python execute string
Python