How do I deal with special characters like \^$.?*|+()[{ in my regex?

by

Escape with a double backslash

R treats backslashes as escape values for character constants. (… and so do regular expressions. Hence the need for two backslashes when supplying a character argument for a pattern. The first one isn’t actually a character, but rather it makes the second one into a character.) You can see how they are processed using cat.

y <- "double quote: \", tab: \t, newline: \n, unicode point: \u20AC"
print(y)
## [1] "double quote: \", tab: \t, newline: \n, unicode point: €"
cat(y)
## double quote: ", tab:    , newline: 
## , unicode point: €

Further reading: Escaping a backslash with a backslash in R produces 2 backslashes in a string, not 1

To use special characters in a regular expression the simplest method is usually to escape them with a backslash, but as noted above, the backslash itself needs to be escaped.

grepl("\\[", "a[b")
## [1] TRUE

To match backslashes, you need to double escape, resulting in four backslashes.

grepl("\\\\", c("a\\b", "a\nb"))
## [1]  TRUE FALSE

The rebus package contains constants for each of the special characters to save you mistyping slashes.

library(rebus)
OPEN_BRACKET
## [1] "\\["
BACKSLASH
## [1] "\\\\"

For more examples see:

?SpecialCharacters

Your problem can be solved this way:

library(rebus)
grepl(OPEN_BRACKET, "a[b")

Form a character class

You can also wrap the special characters in square brackets to form a character class.

grepl("[?]", "a?b")
## [1] TRUE

Two of the special characters have special meaning inside character classes: \ and ^.

Backslash still needs to be escaped even if it is inside a character class.

grepl("[\\\\]", c("a\\b", "a\nb"))
## [1]  TRUE FALSE

Caret only needs to be escaped if it is directly after the opening square bracket.

grepl("[ ^]", "a^b")  # matches spaces as well.
## [1] TRUE
grepl("[\\^]", "a^b") 
## [1] TRUE

rebus also lets you form a character class.

char_class("?")
## <regex> [?]

Use a pre-existing character class

If you want to match all punctuation, you can use the [:punct:] character class.

grepl("[[:punct:]]", c("//", "[", "(", "{", "?", "^", "$"))
## [1] TRUE TRUE TRUE TRUE TRUE TRUE TRUE

stringi maps this to the Unicode General Category for punctuation, so its behaviour is slightly different.

stri_detect_regex(c("//", "[", "(", "{", "?", "^", "$"), "[[:punct:]]")
## [1]  TRUE  TRUE  TRUE  TRUE  TRUE FALSE FALSE

You can also use the cross-platform syntax for accessing a UGC.

stri_detect_regex(c("//", "[", "(", "{", "?", "^", "$"), "\\p{P}")
## [1]  TRUE  TRUE  TRUE  TRUE  TRUE FALSE FALSE

Use \Q \E escapes

Placing characters between \\Q and \\E makes the regular expression engine treat them literally rather than as regular expressions.

grepl("\\Q.\\E", "a.b")
## [1] TRUE

rebus lets you write literal blocks of regular expressions.

literal(".")
## <regex> \Q.\E

Don’t use regular expressions

Regular expressions are not always the answer. If you want to match a fixed string then you can do, for example:

grepl("[", "a[b", fixed = TRUE)
stringr::str_detect("a[b", fixed("["))
stringi::stri_detect_fixed("a[b", "[")

More Related Contents:

  1. How to measure similarity between strings?
  2. How to calculate the number of occurrence of a given character in each row of a column of strings?
  3. Extracting a string between other two strings in R
  4. How to remove all whitespace from a string?
  5. Replace single backslash in R
  6. Extract a substring according to a pattern
  7. Test if characters are in a string
  8. Extract a regular expression match
  9. Remove all special characters from a string in R?
  10. Regex group capture in R with multiple capture-groups
  11. Why does strsplit use positive lookahead and lookbehind assertion matches differently?
  12. Create new column in dataframe based on partial string matching other column
  13. Remove all text between two brackets
  14. R/regex with stringi/ICU: why is a ‘+’ considered a non-[:punct:] character?
  15. Remove numbers from alphanumeric characters
  16. Convert dd/mm/yy and dd/mm/yyyy to Dates
  17. Why is this regex using lookbehinds invalid in R?
  18. Select rows from data.frame ending with a specific character string in R
  19. Use gsub remove all string before first white space in R
  20. Why can’t you use repetition quantifiers in zero-width look behind assertions?
  21. Complete word matching using grepl in R
  22. Find the location of a character in string
  23. Splitting a string on the first space
  24. Is there an R function to escape a string for regex characters
  25. Overlapping matches in R
  26. Extract a string between patterns/delimiters in R
  27. Regex return file name, remove path and file extension
  28. Remove all characters before a period in a string
  29. Replace first occurrence of “:” but not second in R
  30. Get Twitter @Username with Regex in R

Leave a Comment