/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote268 views1 answer
Python seeded random
Python
0 vote247 views1 answer
Radio button selected event
Python
4 votes285 views1 answer
End python program
Python
8 votes284 views2 answers
How to check if a word is in a dictionary
Python
0 vote273 views1 answer
How to load user from jwt token request django
Python
34 votes272 views2 answers
Python create nested directory
Python
4 votes272 views1 answer
Delete element of a list from another list python
Python
0 vote291 views1 answer
Python plot axis labels
Python
-2 votes273 views1 answer
What is xbox live called now
Python
2 votes301 views2 answers
How to read then overwrite a file with python
Python