/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote296 views1 answer
Python opendatasets
Python
0 vote253 views1 answer
End without space in python
Python
1 vote338 views1 answer
Python list .remove() in for loop breaks
Python
30 votes282 views6 answers
Is number python
Python
0 vote323 views1 answer
Exit() function
Python
0 vote282 views1 answer
Get one from dataloader
Python
3 votes276 views4 answers
Discord.py permissions
Python
12 votes312 views3 answers
Python pandas read_csv tsv
Python
1 vote284 views1 answer
Python change base function
Python
1 vote240 views1 answer
Matplotlib remove x and y labels
Python