/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

3 votes164 views1 answer
Python print float in scientific notation
Python
3 votes161 views2 answers
Find all indices of element in string python
Python
4 votes189 views2 answers
Python image to grayscale
Python
0 vote250 views1 answer
Pip install scrapy-proxy-pool
Python
1 vote209 views1 answer
Geometric progression in python
Python
0 vote167 views2 answers
Logger
Python
0 vote167 views1 answer
Python turn off printing
Python
0 vote157 views2 answers
How to run turtle in python
Python
0 vote171 views1 answer
Values missing comparing datasets
Python
0 vote203 views5 answers
Django-tool-bar
Python Django