/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

1 vote607 views1 answer
TypeError: unhashable type: 'list' python dictionary
Python
0 vote745 views1 answer
Fibonacci sequence python genorator
Python
1 vote321 views1 answer
Emacs region indent python
Python
0 vote327 views1 answer
Python db access though ssh user
Python
0 vote324 views1 answer
For pyton
Python
3 votes321 views2 answers
Python dict order a dict by key
Python
1 vote321 views1 answer
Create alinked list inb pyhton
Python
4 votes327 views4 answers
Jupyter lab autocomplete
Python
1 vote344 views1 answer
How to convert a pandas series from int to float in python
Python
1 vote309 views1 answer
•ImportError: cannot import name 'tf_utils'
Python