Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

19 votes318 views1 answer
10 minute timer
Python
8 votes315 views2 answers
Print list in one line python
Python
1 vote306 views1 answer
Rock paper scissors python
Python
20 votes345 views3 answers
Python sort list in reverse
Python
0 vote316 views1 answer
ModuleNotFoundError: No module named 'myapp' alembic
Python
0 vote330 views1 answer
PYTHON 3.0 MAKE A HEART
Python
4 votes344 views4 answers
Whatsapp api
Python
-1 vote299 views1 answer
Unocode error pytonn
Python
0 vote329 views1 answer
Python counting subfolders on specific level
Python
1 vote324 views1 answer
Python define 2d table
Python