/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

52 votes365 views3 answers
How to make a venv python
Python
0 vote341 views1 answer
Pandas remove multi header from dataframe
Python
0 vote346 views1 answer
Not mutable data type in python
Python
0 vote363 views1 answer
Python hello world web application
Python
34 votes343 views4 answers
Print Without Newline
Python
0 vote373 views1 answer
Intersection of two lists using set method
Python
0 vote300 views1 answer
Python concatenate dictionaries
Python
0 vote348 views1 answer
Delete all small Latin letters a from the given string.
Python
1 vote334 views2 answers
No changes detected in app django
Python
20 votes350 views4 answers
How to make computer go in sleep mode using pythn
Python