Pandas groupby with categories with redundant nan

by

Since Pandas 0.23.0, the groupby method can now take a parameter observed which fixes this issue if it is set to True (False by default).
Below is the exact same code as in the question with just observed=True added : 

import pandas as pd

group_cols = ['Group1', 'Group2', 'Group3']

df = pd.DataFrame([['A', 'B', 'C', 54.34],
                   ['A', 'B', 'D', 61.34],
                   ['B', 'A', 'C', 514.5],
                   ['B', 'A', 'A', 765.4],
                   ['A', 'B', 'D', 765.4]],
                  columns=(group_cols+['Value']))

for col in group_cols:
    df[col] = df[col].astype('category')

df.groupby(group_cols, as_index=False, observed=True).sum()

enter image description here

More Related Contents:

  1. why does pandas rolling use single dimension ndarray
  2. How can I pivot a dataframe?
  3. Get statistics for each group (such as count, mean, etc) using pandas GroupBy?
  4. How do I create a new column from the output of pandas groupby().sum()?
  5. GroupBy pandas DataFrame and select most common value
  6. Pandas GroupBy.apply method duplicates first group
  7. pandas GroupBy columns with NaN (missing) values
  8. Count unique values per groups with Pandas [duplicate]
  9. How to access pandas groupby dataframe by key
  10. group by pandas dataframe and select latest in each group
  11. Pandas GroupBy and select rows with the minimum value in a specific column
  12. Group dataframe and get sum AND count?
  13. Sample each group after pandas groupby
  14. Is there an “ungroup by” operation opposite to .groupby in pandas?
  15. get first and last values in a groupby
  16. Pandas groupby and aggregation output should include all the original columns (including the ones not aggregated on)
  17. Get the row corresponding to the max in pandas GroupBy [duplicate]
  18. How to get number of groups in a groupby object in pandas?
  19. Replacing values represented by 'UN' with NaN
  20. How to group dataframe rows into list in pandas groupby
  21. Groupby value counts on the dataframe pandas
  22. pandas select from Dataframe using startswith
  23. What’s the fastest way in Python to calculate cosine similarity given sparse matrix data?
  24. How can I map True/False to 1/0 in a Pandas DataFrame?
  25. Pandas: convert dtype ‘object’ to int
  26. Most efficient way to sort an array into bins specified by an index array?
  27. Find symmetric pairs quickly in numpy
  28. Transform vs. aggregate in Pandas
  29. Load CSV to Pandas MultiIndex DataFrame
  30. Python pandas – new column’s value if the item is in the list

Leave a Comment