Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

42 votes324 views6 answers
Train test split pandas
Python
0 vote315 views1 answer
How to def a variable in python
Python
2 votes392 views2 answers
Get element pandas
Python
3 votes393 views2 answers
Django rest framework simple jwt
Python
0 vote319 views1 answer
Django creat app return _bootstrap._gcd_import
Python Django
10 votes375 views2 answers
Django import settings
Python Django
0 vote355 views1 answer
How to add list as a column to dataframe
Python
0 vote349 views1 answer
How to union value without the same value in numpy
Python
0 vote348 views1 answer
Python sort a 2d array by custom function
Python
1 vote329 views1 answer
Olst = [] a = int(input()) b = int(input()) for ele in range(a,b+1): if ele%2 != 0: olst.append(ele) print(olst[::-1])
Python