Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

5 votes366 views3 answers
Remove help command discord py
Python
0 vote327 views1 answer
Dockerize django app
Python
0 vote348 views1 answer
Access django server from another machine
Python
0 vote351 views1 answer
How to multiply integer value with float values in python
Python
0 vote348 views1 answer
Ordereddict move to end
Python
1 vote362 views1 answer
How to have add break for a few seconds in python
Python
12 votes382 views2 answers
Append file to list python
Python
1 vote349 views1 answer
For en python
Python
1 vote390 views2 answers
Dfs algorithm python
Python
0 vote347 views1 answer
What is manage.py
Python