Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote359 views1 answer
Python frozenset()
Python
0 vote279 views1 answer
Check status code urllib open
Python
0 vote357 views1 answer
Flask_uploads.exceptions.UploadNotAllowed
Python Flask
0 vote316 views1 answer
How to convert each string to a category or int in python dataframe
Python
0 vote311 views1 answer
Split pandas dataframe in two
Python
0 vote304 views1 answer
Pyspark rdd method
Python
0 vote284 views1 answer
Read://https_www.tumblr.com/?url=https://www.tumblr.com/login?redirect_to=%2Fneue_web%2Fiframe%2Freblog%2F629907744681590784%2FjQw7OUs8&3739a18c-0c68-43cc-a4cb-b8b99e9bfd72=a52e06db-92b6-4b86-b3c5-fa2ab267405c
Python
0 vote308 views1 answer
Dataframe select row by index value
Python
0 vote306 views1 answer
Scrollable table tkinter
Python
1 vote345 views1 answer
How to add char to string python
Python