/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

-1 vote346 views6 answers
List comprehension python
Python
0 vote356 views1 answer
Free download django app for windows 10
Python Django
0 vote330 views1 answer
Xlabel font size python latex
Python
-1 vote314 views1 answer
Car python program
Python
0 vote303 views1 answer
Pyqt close application
Python
28 votes297 views6 answers
Flatten list python
Python
0 vote351 views2 answers
Check anonim user django
Python Django
0 vote334 views1 answer
Python print a help of a script
Python
0 vote308 views1 answer
Get the name of a current script in python
Python
1 vote310 views2 answers
Python 7zip extract
Python