/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

84 votes261 views6 answers
Python datetime from string
Python
0 vote284 views1 answer
Basic pygame window
Python
0 vote276 views1 answer
Determine how 2 string si equal py
Python
1 vote270 views1 answer
Min max and avg function of python
Python
0 vote267 views1 answer
In deserialize_keras_object raise ValueError('Unknown ' + printable_module_name + ':' + object_name) ValueError: Unknown loss function:contrastive_loss
Python
0 vote275 views2 answers
Auto py to exe download for windows
Python
1 vote288 views1 answer
Django return only part of string
Python Django
2 votes552 views4 answers
Utf-8 codec can't decode byte python
Python
0 vote283 views1 answer
Dataframe how to substruct 2 dates
Python
61 votes269 views2 answers
For i
Python