/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

5 votes270 views1 answer
Py2exe
Python
1 vote271 views1 answer
Exception: ROM is missing for space_invaders, see https://github.com/openai/atari-py#roms for instructions site:stackoverflow.com
Python
0 vote237 views1 answer
Django db_index=true
Python Django
0 vote226 views1 answer
Python set remove if exists
Python
0 vote248 views1 answer
Python Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong t o it which would lead to only a partial uninstall when trying to install chatterbot or chatterbot_corpus
Python
1 vote224 views2 answers
Check if user has manage messages discord.py
Python
0 vote240 views1 answer
Fastapi-sqlalchemy
Python
0 vote227 views1 answer
How to check if a list is a subset of another list
Python
0 vote331 views1 answer
How to fetch only the columns from a datframe which has a particular datatype
Python
0 vote220 views1 answer
Input np.array
Python