Pandas groupby

data.groupby('month', as_index=False).agg({"duration": "sum"})

Source: shanelynn.ie

Pandas new df from groupby

df = pd.DataFrame(old_df.groupby(['groupby_attribute'])['mean_attribute'].mean())
df = df.reset_index()
df

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Groupby as_index=false

When you use as_index=False , you indicate to groupby() that you don't want to set the column ID as the index (duh!). ... Using as_index=True allows you to apply a sum over axis=1 without specifying the names of the columns, then summing the value over axis 0.

Pandas groupby

>>> emp.groupby(['dept', 'gender']).agg({'salary':'mean'}).round(-3)

Source: medium.com

Pandas groupby

# usage example
gb = df.groupby(["col1", "col2"])
counts = gb.size().to_frame(name="counts")
count
(
    counts.join(gb.agg({"col3": "mean"}).rename(columns={"col3": "col3_mean"}))
    .join(gb.agg({"col4": "median"}).rename(columns={"col4": "col4_median"}))
    .join(gb.agg({"col4": "min"}).rename(columns={"col4": "col4_min"}))
    .reset_index()
)

# to create dataframe
keys = np.array(
    [
        ["A", "B"],
        ["A", "B"],
        ["A", "B"],
        ["A", "B"],
        ["C", "D"],
        ["C", "D"],
        ["C", "D"],
        ["E", "F"],
        ["E", "F"],
        ["G", "H"],
    ]
)



df = pd.DataFrame(
    np.hstack([keys, np.random.randn(10, 4).round(2)]), columns=["col1", "col2", "col3", "col4", "col5", "col6"]
)
df[["col3", "col4", "col5", "col6"]] = df[["col3", "col4", "col5", "col6"]].astype(float)

Source: stackoverflow.com

Similar codes

0 vote313 views1 answer
Remove cog in discord.py
Python
11 votes278 views2 answers
Re.compile example
Python
15 votes303 views5 answers
List of dataframe to dataframe
Python
10 votes292 views4 answers
Discord.py events
Python
0 vote271 views1 answer
Flask restful api post example
Python
17 votes240 views5 answers
Read data from csv python
Python
0 vote287 views1 answer
Turn off warning when import python
Python
6 votes285 views2 answers
Python change working directory to file directory
Python
1 vote282 views2 answers
Count elements in columns pandas
Python
83 votes304 views2 answers
Download python for windows7 64 bit
Python