/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote219 views1 answer
Graph bokeh
Python
1 vote199 views6 answers
Tuples in python
Python
0 vote200 views1 answer
Open link in tab new trong selenium python
Python
1 vote193 views1 answer
Numpy replicate array
Python
1 vote191 views1 answer
Python remove none from dict
Python
0 vote235 views1 answer
Pandas resample fill missing values
Python
0 vote217 views1 answer
Sklearn kmeans mnist
Python
1 vote195 views3 answers
How to access variable of one function in another function in python
Python
4 votes245 views5 answers
Min max python
Python
1 vote202 views1 answer
Python seconds counter
Python