Referring to data.table columns by names saved in variables

by

If you are going to be doing complicated operations inside your j expressions, you should probably use eval and quote. One problem with that in current version of data.table is that the environment of eval is not always correctly processed – eval and quote in data.table (Note: There has been an update to that answer based on an update to the package.) – and the current fix for that is to add .SD to eval. As far as I can tell from a few tests that I’ve run this doesn’t affect speed (the way e.g. having .SD[1] in j would).

Interestingly this issue only plagues the j and you’ll be fine using eval normally in i (where .SD is not available anyway).

The other problem is assignment, and there you have to have strings. I know one way to extract the string name from a quoted expression – it’s not pretty, but it works. Here’s an example combining everything together:

x = data.table(dist = c(1:10), val = c(1:10))
distcol = quote(dist)
valcol = quote(val)

x[eval(valcol) < 5,
  capture.output(str(distcol, give.head = F)) := eval(distcol)*sum(eval(distcol, .SD))]

Note how I was ok not adding .SD in one eval(distcol), but won’t be if I take it out of the other eval.

Another option is to use get:

diststr = "dist"
valstr = "val"

x[get(valstr) < 5, c(diststr) := get(diststr)*sum(get(diststr))]

More Related Contents:

  1. Overlap join with start and end positions
  2. data.table vs dplyr: can one do something well the other can’t or does poorly?
  3. How to delete a row by reference in data.table?
  4. Why does X[Y] join of data.tables not allow a full outer join, or a left join?
  5. dplyr mutate/replace several columns on a subset of rows
  6. Proper/fastest way to reshape a data.table
  7. Filtering out duplicated/non-unique rows in data.table
  8. Data.table meta-programming
  9. data.table with two string columns of set elements, extract unique rows with each row unsorted
  10. Creating dummy variables in R data.table
  11. Elegantly assigning multiple columns in data.table with lapply()
  12. Sort a data.table fast by Ascending/Descending order
  13. No RTools compatible with R version 3.5.0 was found
  14. Join R data.tables where key values are not exactly equal–combine rows with closest times
  15. how to show a legend on dual y-axis ggplot
  16. Why is as.Date slow on a character vector?
  17. Cleaning `Inf` values from an R dataframe
  18. How to group data.table by multiple columns?
  19. can the value.var in dcast be a list or have multiple value variables?
  20. Apply a function to a subset of data.table columns, by column-indices instead of name
  21. Selecting a subset of columns in a data.table
  22. Merge overlapping ranges into unique groups, in dataframe
  23. add missing rows to a data table
  24. `dcast` with empty RHS [duplicate]
  25. Convert a data frame to a data.table without copy
  26. Row sums over columns with a certain pattern in their name
  27. data.table package in R 3.5 does not install
  28. paste two data.table columns
  29. Removing multiple columns from R data.table with parameter for columns to remove
  30. Fill option for fread

Leave a Comment