/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote170 views1 answer
Python paramiko
Python
0 vote165 views1 answer
Get os environment python
Python
0 vote230 views2 answers
Types of methods in oop python
Python
5 votes166 views6 answers
Matplotlib subplots
Python
1 vote161 views2 answers
Changing default python version ubuntu
Python
13 votes173 views3 answers
Window in python
Python
2 votes176 views1 answer
How to make python3.9 active
Python
12 votes186 views10 answers
Google
Python
31 votes165 views3 answers
Insert in Python
Python
0 vote185 views2 answers
How to color label in pyqt5
Python