/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote320 views1 answer
Type object 'object' has no attribute 'dtype' when create dataframe from pandas
Python
0 vote291 views1 answer
Updating column values
Python
0 vote349 views3 answers
How to find a word in list python
Python
-2 votes303 views4 answers
Merge multiple dataframs
Python
0 vote298 views1 answer
Pip install google cloud secret manager
Python
0 vote309 views2 answers
Selenium delete cookies python
Python
10 votes305 views6 answers
Formatting in python
Python
20 votes288 views6 answers
Sort list in python
Python
0 vote299 views1 answer
How to check the version of ployly
Python
1 vote286 views1 answer
Module not found not module name channels in python
Python