Is R’s apply family more than syntactic sugar?

by

The apply functions in R don’t provide improved performance over other looping functions (e.g. for). One exception to this is lapply which can be a little faster because it does more work in C code than in R (see this question for an example of this).

But in general, the rule is that you should use an apply function for clarity, not for performance.

I would add to this that apply functions have no side effects, which is an important distinction when it comes to functional programming with R. This can be overridden by using assign or <<-, but that can be very dangerous. Side effects also make a program harder to understand since a variable’s state depends on the history.

Edit:

Just to emphasize this with a trivial example that recursively calculates the Fibonacci sequence; this could be run multiple times to get an accurate measure, but the point is that none of the methods have significantly different performance:

> fibo <- function(n) {
+   if ( n < 2 ) n
+   else fibo(n-1) + fibo(n-2)
+ }
> system.time(for(i in 0:26) fibo(i))
   user  system elapsed 
   7.48    0.00    7.52 
> system.time(sapply(0:26, fibo))
   user  system elapsed 
   7.50    0.00    7.54 
> system.time(lapply(0:26, fibo))
   user  system elapsed 
   7.48    0.04    7.54 
> library(plyr)
> system.time(ldply(0:26, fibo))
   user  system elapsed 
   7.52    0.00    7.58

Edit 2:

Regarding the usage of parallel packages for R (e.g. rpvm, rmpi, snow), these do generally provide apply family functions (even the foreach package is essentially equivalent, despite the name). Here’s a simple example of the sapply function in snow:

library(snow)
cl <- makeSOCKcluster(c("localhost","localhost"))
parSapply(cl, 1:20, get("+"), 3)

This example uses a socket cluster, for which no additional software needs to be installed; otherwise you will need something like PVM or MPI (see Tierney’s clustering page). snow has the following apply functions:

parLapply(cl, x, fun, ...)
parSapply(cl, X, FUN, ..., simplify = TRUE, USE.NAMES = TRUE)
parApply(cl, X, MARGIN, FUN, ...)
parRapply(cl, x, fun, ...)
parCapply(cl, x, fun, ...)

It makes sense that apply functions should be used for parallel execution since they have no side effects. When you change a variable value within a for loop, it is globally set. On the other hand, all apply functions can safely be used in parallel because changes are local to the function call (unless you try to use assign or <<-, in which case you can introduce side effects). Needless to say, it’s critical to be careful about local vs. global variables, especially when dealing with parallel execution.

Edit:

Here’s a trivial example to demonstrate the difference between for and *apply so far as side effects are concerned:

> df <- 1:10
> # *apply example
> lapply(2:3, function(i) df <- df * i)
> df
 [1]  1  2  3  4  5  6  7  8  9 10
> # for loop example
> for(i in 2:3) df <- df * i
> df
 [1]  6 12 18 24 30 36 42 48 54 60

Note how the df in the parent environment is altered by for but not *apply.

More Related Contents:

  1. how to apply a function on a data set?
  2. Is the “*apply” family really not vectorized?
  3. Remove columns from dataframe where ALL values are NA
  4. Faster way to read fixed-width files
  5. R Apply() function on specific dataframe columns
  6. Concatenate row-wise across specific columns of dataframe
  7. subset a column in data frame based on another data frame/list
  8. Remove/collapse consecutive duplicate values in sequence
  9. Pasting elements of two vectors alphabetically
  10. Apply a function to every row of a matrix or a data frame
  11. Why is `vapply` safer than `sapply`?
  12. Is there a R function that applies a function to each pair of columns?
  13. Why apply() returns a transposed xts matrix?
  14. How to paste a string on each element of a vector of strings using apply in R?
  15. Sum every nth points
  16. Why does as.factor return a character when used inside apply?
  17. apply a function over groups of columns
  18. rbind data frames based on a common pattern in data frame name
  19. Dataframe create new column based on other columns
  20. Calculate row-wise proportions
  21. Last Observation Carried Forward In a data frame? [duplicate]
  22. Sorting rows alphabetically
  23. use multiple columns as variables with sapply
  24. Applying a function to two lists?
  25. Apply function to each column in a data frame observing each columns existing data type
  26. how to access global/outer scope variable from R apply function?
  27. apply() not working when checking column class in a data.frame
  28. How to upgrade R in ubuntu? [closed]
  29. How can I load an object into a variable name that I specify from an R data file?
  30. Multiply columns in a data frame by a vector

Leave a Comment