Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

6 votes159 views1 answer
How to get just the filename in python
Python
5 votes164 views3 answers
Start virtualenv
Python
1 vote198 views1 answer
Delete and start fresh with db django
Python Django
0 vote179 views1 answer
"'S3' object has no attribute 'Bucket'", python boto3 aws
Python
0 vote188 views1 answer
Turn false true column into 0 1 pandas
Python
10 votes169 views2 answers
Python create file if doesbt exist
Python
0 vote175 views1 answer
How to find permutation of numbers in python
Python
0 vote196 views1 answer
Relative text size put text cv2
Python
0 vote161 views1 answer
How to write flow of execution in python
Python
4 votes177 views1 answer
Find text between two strings regex python
Python