/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

-2 votes206 views1 answer
Play sound directly with pytts
Python
0 vote222 views1 answer
Write int in file python
Python
0 vote201 views1 answer
Django generate openapi schema command line
Python
0 vote218 views1 answer
From plyfile import PlyData ModuleNotFoundError: No module named 'plyfile'
Python
-3 votes220 views2 answers
Pypy
Python
0 vote218 views1 answer
How to remove a list of numbers from a list in python
Python
1 vote215 views1 answer
__delattr__ python
Python
4 votes243 views3 answers
Python get int from string
Python
0 vote217 views1 answer
Python datetime now only hour and minute
Python
0 vote233 views1 answer
Star psf
Python