/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote322 views1 answer
File "pandas/_libs/index.pyx", line 465, in pandas._libs.index.DatetimeEngine.get_loc KeyError: Timestamp('2019-01-02 07:09:00')
Python
-3 votes363 views2 answers
Python parse xml string
Python
1 vote335 views1 answer
Python Convert a string to lowercase
Python
5 votes348 views3 answers
Python calculate prime numbers until numer
Python
3 votes361 views1 answer
Python more order of columns
Python
23 votes315 views6 answers
How to check if a number is even or odd in python
Python
-1 vote372 views1 answer
Let’s add a docstring to the greeting method. How about, “Outputs a message with the name of the person”.
Python
0 vote335 views1 answer
How change column strin of list data type to list
Python
1 vote335 views1 answer
Different states of a button tkinter
Python
1 vote346 views1 answer
Python function to do comparison between two numbers
Python