/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

-1 vote282 views1 answer
Sort dict based on other list
Python
0 vote301 views1 answer
Python youtube downloader github
Python
0 vote200 views1 answer
Triangle quest
Python
21 votes224 views10 answers
How to print in python
Python
35 votes263 views6 answers
Generate random string python
Python
0 vote252 views1 answer
<type 'file'> python3
Python
11 votes257 views1 answer
Selecting items in a column of a dataframe
Python
5 votes249 views1 answer
Show full pd dataframe
Python
0 vote234 views2 answers
Print 2 letter python
Python
3 votes258 views2 answers
Matplotlib log scale y axis base
Python