Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote166 views1 answer
Check if numpy array contains only duplicates
Python
39 votes173 views6 answers
Python generate requirements.txt
Python
3 votes172 views2 answers
Print first word of a string python and return it
Python
0 vote161 views1 answer
Prevent selenium from closing
Python
30 votes200 views3 answers
How to get decimal part of a double in python
Python
0 vote191 views1 answer
Django refresh form db
Python
0 vote179 views1 answer
Write a line to a text file using the write() function
Python
40 votes252 views5 answers
Python print list as string
Python
-2 votes178 views2 answers
Entered_text_1 = textbox_1.get(1.0, tk.END+"-1c")
Python
21 votes194 views5 answers
Decode base64 python
Python