/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote311 views1 answer
Apply boolean to list
Python
0 vote334 views1 answer
Django dumpdata specific app
Python Django
105 votes294 views6 answers
Split string python
Python
1 vote295 views1 answer
Flatten json python
Python
2 votes316 views1 answer
Add a list in python
Python
36 votes319 views2 answers
ModuleNotFoundError: No module named 'sklearn'
Python
8 votes282 views3 answers
Django sort queryset
Python
0 vote287 views1 answer
Matplotlib doesnt show suptitle
Python
4 votes304 views6 answers
Recursion in python
Python
9 votes312 views6 answers
Elif python
Python