Pyspark pivot max aggregation

from pyspark.sql.functions import *
from pyspark.sql import Window
var win = Window.partitionBy("date") 
data.withColumn("max_vol",max("volume").over(win)).groupBy("date","max_vol") .pivot("recipe") .agg(avg("percent")).show()

Source: stackoverflow.com

Similar codes

29 votes403 views4 answers
Basic flask app python
Python Flask
1 vote315 views1 answer
Delete folders using python
Python
0 vote360 views1 answer
How to run django server outside world
Python Django
0 vote322 views2 answers
Python min value index from an array
Python
10 votes329 views4 answers
How to append a dataframe to another dataframe in pandas
Python
22 votes277 views2 answers
Range() function
Python
21 votes349 views3 answers
Python if not null or empty
Python
2 votes319 views2 answers
How to read csv file online into pandas
Python
0 vote298 views1 answer
Cursor.fetchall() to list
Python
35 votes328 views3 answers
Path of current working directory with os module python
Python