Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote159 views1 answer
Networkx draw edge description
Python
1 vote213 views1 answer
Import status in django rest framework
Python Django
10 votes177 views4 answers
How to check if Python is 32 or 64 bit
Python
3 votes165 views1 answer
Blackjack in python
Python
1 vote160 views1 answer
Raise_for_status() requests
Python
-1 vote148 views1 answer
Pip path windows 10
Python
0 vote173 views1 answer
Find each geometry overlap python
Python
1 vote176 views1 answer
Python snakes
Python
1 vote172 views1 answer
TypeError: ‘builtin_function_or_method’ object is not subscriptable
Python
-1 vote152 views1 answer
Get the largest of 2 strings python
Python