Pyspark pivot max aggregation

from pyspark.sql.functions import *
from pyspark.sql import Window
var win = Window.partitionBy("date") 
data.withColumn("max_vol",max("volume").over(win)).groupBy("date","max_vol") .pivot("recipe") .agg(avg("percent")).show()

Source: stackoverflow.com

Similar codes

23 votes306 views5 answers
Json in python
Python
0 vote329 views3 answers
Python unittest mock
Python
0 vote299 views1 answer
Python identify array
Python
0 vote375 views1 answer
Running code once in a while loop python
Python
8 votes379 views5 answers
No module psycopg2
Python
0 vote344 views1 answer
Matplotlib different number of subplots
Python
10 votes322 views2 answers
Create dict from json file python
Python
0 vote311 views1 answer
Python parcourir ligne
Python
0 vote324 views1 answer
User passes test django
Python
8 votes309 views2 answers
Python local server command
Python