/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote234 views1 answer
Brainf**k Interpreter in Python
Python
0 vote263 views1 answer
Cv2 put font on center
Python
0 vote275 views1 answer
Selenium python class contains
Python
0 vote272 views1 answer
India states django choices
Python
0 vote222 views1 answer
Minio python create bucket
Python
0 vote299 views1 answer
How to get a mock image in django?
Python Django
0 vote240 views1 answer
Python syntax error jedi
Python
0 vote231 views1 answer
Python mypy cast
Python
22 votes230 views10 answers
Cat
Python
6 votes238 views3 answers
Flask get ip of user
Python