Add a row by reference at the end of a data.table object

by

To answer your edit, just run a benchmark:

a = data.table(id=letters[1:2], var=1:2)
b = copy(a)
c = copy(b) # let's also just try modifying same value in place
            # to see how well changing existing values does
microbenchmark(a <- rbind(a, data.table(id="c", var=3)),
               b <- rbindlist(list(b,  data.table(id="c", var=3))),
               c[1, var := 3L],
               set(c, 1L, 2L, 3L))
#Unit: microseconds
#                                                  expr     min        lq    median        uq      max neval
#          a <- rbind(a, data.table(id = "c", var = 3)) 865.460 1141.2585 1357.1230 1539.4300 6814.492   100
#b <- rbindlist(list(b, data.table(id = "c", var = 3))) 260.440  325.3835  445.4190  522.8825 1143.930   100
#                                   c[1, `:=`(var, 3L)] 482.147  626.5570  778.3135  904.3595 1109.539   100
#                                    set(c, 1L, 2L, 3L)   2.339    5.677    7.5140    9.5170   19.033   100

rbindlist is clearly better than rbind. Thanks to Matthew Dowle pointing out the problems with using [ in a loop, I added another benchmark with set.

From the above your best options are using rbindlist, or sizing the data.table to begin with and then just populating the values (you can also use a similar strategy to std::vector in C++, and double the size every time you run out of space, if you don’t know the size of the data to begin with, and then once you’re done filling it in, delete the extra rows).

More Related Contents:

  1. Naming columns in a data table in R
  2. How to create a lag variable within each group?
  3. data.table objects assigned with := from within function not printed
  4. What is the purpose of setting a key in data.table?
  5. .EACHI in data.table?
  6. Use a value from the previous row in an R data.table calculation
  7. How to efficiently calculate distance between pair of coordinates using data.table :=
  8. Sample random rows within each group in a data.table
  9. Melt using patterns when variable names contain string information – avoid coercion to numeric
  10. Error: package or namespace load failed for ggplot2 and for data.table
  11. How to perform join over date ranges using data.table?
  12. Split text string in a data.table columns
  13. How to speed up subset by groups
  14. knitr gets tricked by data.table `:=` assignment
  15. Add multiple columns to R data.table in one function call?
  16. Extract a column from a data.table as a vector, by position
  17. data.table equivalent of tidyr::complete()
  18. data.table merge based on date ranges
  19. Reason behind speed of fread in data.table package in R
  20. data.table row-wise sum, mean, min, max like dplyr?
  21. := (pass by reference) operator in the data.table package modifies another data table object simultaneously
  22. Rowwise cumulative sum
  23. Using data.table i and j arguments in functions
  24. R data.table breaks in exported functions
  25. Applying a function to each row of a data.table
  26. Empty factors in “by” data.table
  27. When and why does “print” need two attempts to print a “data.table”? [duplicate]
  28. How to use data.table within functions and loops?
  29. What you can do with a data.frame that you can’t with a data.table?
  30. data.table: anonymous function in j

Leave a Comment