Does ifelse really calculate both of its vectors every time? Is it slow?

by

Yes. (With exception)

ifelse calculates both its yes value and its no value. Except in the case where the test condition is either all TRUE or all FALSE.

We can see this by generating random numbers and observing how many numbers are actually generated. (by reverting the seed). 

# TEST CONDITION, ALL TRUE
set.seed(1)
dump  <- ifelse(rep(TRUE, 200), rnorm(200), rnorm(200))
next.random.number.after.all.true <- rnorm(1)

# TEST CONDITION, ALL FALSE
set.seed(1)
dump  <- ifelse(rep(FALSE, 200), rnorm(200), rnorm(200))
next.random.number.after.all.false <- rnorm(1)

# TEST CONDITION, MIXED
set.seed(1)
dump   <- ifelse(c(FALSE, rep(TRUE, 199)), rnorm(200), rnorm(200))
next.random.number.after.some.TRUE.some.FALSE <- rnorm(1)

# RESET THE SEED, GENERATE SEVERAL RANDOM NUMBERS TO SEARCH FOR A MATCH
set.seed(1)
r.1000 <- rnorm(1000)


cat("Quantity of random numbers generated during the `ifelse` statement when:", 
    "\n\tAll True  ", which(r.1000 == next.random.number.after.all.true) - 1,
    "\n\tAll False ", which(r.1000 == next.random.number.after.all.false) - 1,
    "\n\tMixed T/F ", which(r.1000 == next.random.number.after.some.TRUE.some.FALSE) - 1 
  )

Gives the following output: 

Quantity of random numbers generated during the `ifelse` statement when: 
  All True   200 
  All False  200 
  Mixed T/F  400   <~~ Notice TWICE AS MANY numbers were
                       generated when `test` had both
                       T & F values present

We can also see it in the source code itself:

.
.
if (any(test[!nas]))    
    ans[test & !nas] <- rep(yes, length.out = length(ans))[test &   # <~~~~ This line and the one below
        !nas]
if (any(!test[!nas])) 
    ans[!test & !nas] <- rep(no, length.out = length(ans))[!test &  # <~~~~ ... are the cluprits
        !nas]
.
.

Notice that yes and no are computed only if there
is some non-NA value of test that is TRUE or FALSE (respectively).
At which point — and this is the imporant part when it comes to efficiency — the entirety of each vector is computed.

Ok, but is it slower?

Lets see if we can test it: 

library(microbenchmark)

# Create some sample data
  N <- 1e4
  set.seed(1)
  X <- sample(c(seq(100), rep(NA, 100)), N, TRUE)
  Y <- ifelse(is.na(X), rnorm(X), NA)  # Y has reverse NA/not-NA setup than X

These two statements generate the same results

yesifelse <- quote(sort(ifelse(is.na(X), Y+17, X-17 ) ))
noiflese  <- quote(sort(c(Y[is.na(X)]+17, X[is.na(Y)]-17)))

identical(eval(yesifelse), eval(noiflese))
# [1] TRUE

but one is twice as fast as the other

microbenchmark(eval(yesifelse), eval(noiflese), times=50L)

N = 1,000
Unit: milliseconds
            expr      min       lq   median       uq      max neval
 eval(yesifelse) 2.286621 2.348590 2.411776 2.537604 10.05973    50
  eval(noiflese) 1.088669 1.093864 1.122075 1.149558 61.23110    50

N = 10,000
Unit: milliseconds
            expr      min       lq   median       uq      max neval
 eval(yesifelse) 30.32039 36.19569 38.50461 40.84996 98.77294    50
  eval(noiflese) 12.70274 13.58295 14.38579 20.03587 21.68665    50

More Related Contents:

  1. Is the “*apply” family really not vectorized?
  2. Why can’t R’s ifelse statements return vectors?
  3. Vectorized IF statement in R?
  4. How to prevent ifelse() from turning Date objects into numeric objects
  5. Nested ifelse statement
  6. Interpreting “condition has length > 1” warning from `if` function
  7. Is there an R function for finding the index of an element in a vector?
  8. Fastest way to replace NAs in a large data.table
  9. Can dplyr package be used for conditional mutating?
  10. The condition has length > 1 and only the first element will be used
  11. else if(){} VS ifelse()
  12. Fast pairwise simple linear regression between variables in a data frame
  13. Append an object to a list in R in amortized constant time, O(1)?
  14. Replace negative values by zero
  15. if/else constructs inside and outside functions
  16. if – else if – else statement and brackets
  17. Cumulative sum until maximum reached, then repeat from zero in the next row
  18. R ifelse statement
  19. Sort a data.table fast by Ascending/Descending order
  20. Is there a vectorized parallel max() and min()?
  21. Why doesn’t outer work the way I think it should (in R)?
  22. Create column with grouped values based on another column
  23. Efficiently computing a linear combination of data.table columns
  24. dplyr if_else() vs base R ifelse()
  25. What methods can we use to reshape VERY large data sets?
  26. Create new column based on 4 values in another column
  27. Does the term “vectorization” mean different things in different contexts?
  28. How to generalize outer to n dimensions?
  29. Adding new column with conditional values using ifelse
  30. How do I create a new column based on multiple conditions from multiple columns?

Leave a Comment