/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote319 views1 answer
Django optional path parameter
Python Django
0 vote273 views1 answer
Python find minimum date in list
Python
3 votes265 views1 answer
Numpy how to calculate variance
Python
0 vote257 views2 answers
Sqlite to python list
Python
2 votes263 views2 answers
Check all python versions ubuntu
Python
9 votes285 views6 answers
How to get absolute path in python
Python
8 votes277 views4 answers
Pandas print duplicate rows
Python
0 vote288 views1 answer
How to make a password square multicolor square spiral python
Python
0 vote296 views1 answer
Site:*.instagram.com
Python
0 vote278 views1 answer
Python string: .upper()
Python