/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote294 views1 answer
Python shortest distance between two points
Python
0 vote316 views1 answer
Python check column conditions
Python
4 votes306 views1 answer
How to add variable in list python
Python
2 votes317 views2 answers
How to add elements in a dictionary in python
Python
0 vote341 views1 answer
Python - extract min and max values per each column name
Python
0 vote319 views1 answer
Map function to change type of element in python
Python
0 vote346 views1 answer
Nptel swayam
Python
0 vote297 views1 answer
Sin , Cos Graph using python turtle.
Python
0 vote330 views1 answer
Change command aliad
Python
2 votes333 views1 answer
Python pandas replace nan with null
Python