/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote207 views2 answers
Python add 1
Python
0 vote196 views2 answers
Turn list to string with commas python
Python
0 vote197 views1 answer
What are postcondition errors in python
Python
3 votes173 views1 answer
Starting vscode on colab
Python
11 votes188 views2 answers
Show more rows pandas
Python
-1 vote208 views2 answers
Reading tsv file in python
Python
0 vote314 views1 answer
Rasperry pi camera
Python
0 vote176 views1 answer
Write a python program which accepts the user
Python
9 votes204 views1 answer
Flask tutorials
Python Flask
11 votes199 views6 answers
Enumerate in python
Python