Summarizing multiple columns with dplyr? [duplicate]

by

In dplyr (>=1.00) you may use across(everything() in summarise to apply a function to all variables:

library(dplyr)

df %>% group_by(grp) %>% summarise(across(everything(), list(mean)))
#> # A tibble: 3 x 5
#>     grp     a     b     c     d
#>   <int> <dbl> <dbl> <dbl> <dbl>
#> 1     1  3.08  2.98  2.98  2.91
#> 2     2  3.03  3.04  2.97  2.87
#> 3     3  2.85  2.95  2.95  3.06

Alternatively, the purrrlyr package provides the same functionality:

library(purrrlyr)
df %>% slice_rows("grp") %>% dmap(mean)
#> # A tibble: 3 x 5
#>     grp     a     b     c     d
#>   <int> <dbl> <dbl> <dbl> <dbl>
#> 1     1  3.08  2.98  2.98  2.91
#> 2     2  3.03  3.04  2.97  2.87
#> 3     3  2.85  2.95  2.95  3.06

Also don’t forget about data.table (use keyby to sort sort groups):

library(data.table)
setDT(df)[, lapply(.SD, mean), keyby = grp]
#>    grp        a        b        c        d
#> 1:   1 3.079412 2.979412 2.979412 2.914706
#> 2:   2 3.029126 3.038835 2.967638 2.873786
#> 3:   3 2.854701 2.948718 2.951567 3.062678

Let’s try to compare performance.

library(dplyr)
library(purrrlyr)
library(data.table)
library(bench)
set.seed(123)
n <- 10000
df <- data.frame(
  a = sample(1:5, n, replace = TRUE), 
  b = sample(1:5, n, replace = TRUE), 
  c = sample(1:5, n, replace = TRUE), 
  d = sample(1:5, n, replace = TRUE), 
  grp = sample(1:3, n, replace = TRUE)
)
dt <- setDT(df)
mark(
  dplyr = df %>% group_by(grp) %>% summarise(across(everything(), list(mean))),
  purrrlyr = df %>% slice_rows("grp") %>% dmap(mean),
  data.table = dt[, lapply(.SD, mean), keyby = grp],
  check = FALSE
)
#> # A tibble: 3 x 6
#>   expression      min   median `itr/sec` mem_alloc `gc/sec`
#>   <bch:expr> <bch:tm> <bch:tm>     <dbl> <bch:byt>    <dbl>
#> 1 dplyr        2.81ms   2.85ms      328.        NA     17.3
#> 2 purrrlyr     7.96ms   8.04ms      123.        NA     24.5
#> 3 data.table 596.33µs 707.91µs     1409.        NA     10.3

More Related Contents:

  1. Extract row corresponding to minimum value of a variable by group
  2. R sum a variable by two groups [duplicate]
  3. Run a custom function on a data frame in R, by group
  4. Collapse / concatenate / aggregate a column to a single comma separated string within each group
  5. Replace missing values (NA) with most recent non-NA by group
  6. Getting the top values by group
  7. Filter multiple values on a string column in dplyr
  8. Select the first and last row by group in a data frame
  9. Group by multiple columns in dplyr, using string vector input
  10. R spreading multiple columns with tidyr [duplicate]
  11. Select groups which have at least one of a certain value
  12. Display / print all rows of a tibble (tbl_df)
  13. How to strsplit different number of strings in certain column by do function
  14. Finding Overlaps between interval sets / Efficient Overlap Joins
  15. R dplyr rolling sum
  16. How to remove rows with any zero value
  17. Select columns based on string match – dplyr::select
  18. Delete columns/rows with more than x% missing
  19. How to aggregate a dataframe by week?
  20. adding default values to item x group pairs that don’t have a value (df %>% spread %>% gather seems strange)
  21. Apply several summary functions (sum, mean, etc.) on several variables by group in one call
  22. dplyr mutate rowwise max of range of columns
  23. dplyr: lead() and lag() wrong when used with group_by()
  24. Aggregate data in R
  25. Reorder rows using custom order
  26. Spreading a two column data frame with tidyr
  27. R dplyr rowwise mean or min and other methods?
  28. Dealing with spaces and “weird” characters in column names with dplyr::rename()
  29. Filtering rows in R unexpectedly removes NAs when using subset or dplyr::filter
  30. resetting cumsum if value goes to negative in r

Leave a Comment