/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

1 vote346 views1 answer
How to import PyMem python
Python
23 votes302 views6 answers
How to check if a number is even or odd in python
Python
0 vote335 views1 answer
Train_test_split from sklearn.selection
Python
0 vote329 views1 answer
If object has property python
Python
0 vote351 views1 answer
What if init migrations run two times or by pass this migrate
Python
1 vote323 views1 answer
Python write text file on the next line
Python
16 votes356 views3 answers
Python gitignore
Python
0 vote397 views1 answer
Python frozenset()
Python
3 votes340 views2 answers
Moving element to last position in a list python
Python
0 vote320 views1 answer
Pyspark import stringtype
Python