/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

1 vote231 views2 answers
From sklearn.metrics import classification_report
Python
1 vote189 views1 answer
How to display speechmarks in python string
Python
0 vote212 views1 answer
Read a large dataframe in pandas
Python
1 vote223 views2 answers
Python 7zip extract
Python
1 vote223 views1 answer
Who is rishi smaran = "RISHI SMARAN IS A 12 YEAR OLD NAUGHTY KID WHO CREATED ME"
Python
0 vote215 views1 answer
Chart-studio python install
Python
9 votes296 views5 answers
Get dummies pandas
Python
1 vote235 views1 answer
Get gpu name tensorflow and pytorch
Python
2 votes228 views1 answer
Flip a plot matplotlib
Python
0 vote218 views1 answer
Can the function inside a function be global if the function before it is global
Python