Confused about backslashes in regular expressions [duplicate]

by

The confusion is due to the fact that the backslash character \ is used as an escape at two different levels. First, the Python interpreter itself performs substitutions for \ before the re module ever sees your string. For instance, \n is converted to a newline character, \t is converted to a tab character, etc. To get an actual \ character, you can escape it as well, so \\ gives a single \ character. If the character following the \ isn’t a recognized escape character, then the \ is treated like any other character and passed through, but I don’t recommend depending on this. Instead, always escape your \ characters by doubling them, i.e. \\.

If you want to see how Python is expanding your string escapes, just print out the string. For example:

s="a\\b\tc"
print(s)

If s is part of an aggregate data type, e.g. a list or a tuple, and if you print that aggregate, Python will enclose the string in single quotes and will include the \ escapes (in a canonical form), so be aware of how your string is being printed. If you just type a quoted string into the interpreter, it will also display it enclosed in quotes with \ escapes.

Once you know how your string is being encoded, you can then think about what the re module will do with it. For instance, if you want to escape \ in a string you pass to the re module, you will need to pass \\ to re, which means you will need to use \\\\ in your quoted Python string. The Python string will end up with \\ and the re module will treat this as a single literal \ character.

An alternative way to include \ characters in Python strings is to use raw strings, e.g. r'a\b' is equivalent to "a\\b".

More Related Contents:

  1. Regular expression doesn't produce expected result
  2. Replacing a string by a slightly variation of itself
  3. How t extract last part of a text in python [duplicate]
  4. re.findall behaves weird
  5. Do regular expressions from the re module support word boundaries (\b)?
  6. Python extract pattern matches
  7. Split a string by spaces — preserving quoted substrings — in Python
  8. Does “\d” in regex mean a digit?
  9. Reversing a regular expression in Python
  10. re.findall not returning full match?
  11. re.sub replace with matched content
  12. How to timeout function in python, timeout less than a second
  13. re.sub erroring with “Expected string or bytes-like object”
  14. Can’t use ‘\1’ backreference to capture-group in a function call in re.sub() repr expression
  15. Python regex, matching pattern over multiple lines.. why isn’t this working?
  16. BeautifulSoup returns empty list when searching by compound class names
  17. What does the “r” in pythons re.compile(r’ pattern flags’) mean?
  18. Python regex to match dates
  19. regexes: How to access multiple matches of a group? [duplicate]
  20. Do Python regular expressions have an equivalent to Ruby’s atomic grouping?
  21. Finding words after keyword in python [duplicate]
  22. python re.sub, only replace part of match [duplicate]
  23. Grep and Python
  24. Regexp to remove specific number of occurrences of character only
  25. re.search() only matches the first occurrence
  26. Python: Replace with regex
  27. Remove non-ASCII characters from a string using python / django
  28. How to strip whitespace from before but not after punctuation in python
  29. re.split() gives empty elements in list
  30. Issue with regex backreference in Python

Leave a Comment