/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

19 votes139 views2 answers
How to avoid deprecation warning in python
Python
0 vote117 views2 answers
Django get all models
Python
0 vote110 views1 answer
If user_answer==answer: ecpeted index erroe pythin fx
Python
0 vote112 views2 answers
When excel is loaded into python, numeric datatype changes to float
Python
0 vote108 views1 answer
Scatter plot | create scatter plot
Python
0 vote107 views1 answer
Binary to decimal python
Python
0 vote149 views1 answer
Write a Python program to accept two strings as input and check if they are identical copy of each other or if the second string is a substring of the first string.
Python
0 vote119 views1 answer
DRF: get ip address
Python
0 vote110 views2 answers
Python verifier qu'un string est un chiffre
Python
9 votes108 views2 answers
Python execute string
Python