Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote209 views1 answer
Np print precision
Python
0 vote203 views1 answer
Python count how many times a word appears in a string
Python
1 vote189 views1 answer
Variable plus one python
Python
0 vote226 views1 answer
Starting variable name with underscore python
Python
0 vote195 views1 answer
Pass 2d array to 1d python
Python
0 vote242 views1 answer
Access django server from another machine
Python Django
0 vote245 views1 answer
2pac
Python
0 vote201 views2 answers
Dice Roller in Python
Python
2 votes191 views1 answer
How to get the ip address of laptop with python
Python
0 vote195 views1 answer
How to write flow of execution in python
Python