Why do numbers in a string become “x0n” when a backslash precedes them?

by

In Python string literals, the \ character starts escape sequences. \n translates to a newline character, \t to a tab, etc. \xhh hex sequences let you produce codepoints with hex values instead, \uhhhh produce codepoints with 4-digit hex values, and \Uhhhhhhhh produce codepoints with 8-digit hex values.

See the String and Bytes Literals documentation, which contains a table of all the possible escape sequences.

When Python echoes a string object in the interpreter (or you use the repr() function on a string object), then Python creates a representation of the string value. That representation happens to use the exact same Python string literal syntax, to make it easier to debug your values, as you can use the representation to recreate the exact same value.

To keep non-printable characters from either causing havoc or not be shown at all, Python uses the same escape sequence syntax to represent those characters. Thus bytes that are not printable are represented using suitable \xhh sequences, or if possible, one of the \c single letter escapes (so newlines are shown as \n).

In your example, you created non-printable bytes using the \ooo octal value escape sequence syntax. The digits are interpreted as an octal number to create a corrensponding codepoint. When echoing that string value back, the default \xhh syntax is used to represent the exact same value in hexadecimal:

>>> '\20' # Octal for 16
'\x10'

while your \t became a tab character:

>>> print('\test')
    est

Note how there is no letter t there; instead, the remaining est is indented by whitespace, a horizontal tab.

If you need to include literal \ backslash characters you need to double the character:

>>> '\\test\\1\\2\\3'
'\\test\\1\\2\\3'
>>> print('\\test\\1\\2\\3')
\test\1\2\3
>>> len('\\test\\1\\2\\3')
11

Note that the representation used doubled backslashes! If it didn’t, you’d not be able to copy the string and paste it back into Python to recreate the value. Using print() to write the value to the terminal as actual characters (and not as a string representation) shows that there are single backslashes there, and taking the length shows we have just 11 characters in the string, not 15.

You can also use a raw string literal. That’s just a different syntax, the string objects that are created from the syntax are the exact same type, with the same value. It is just a different way of spelling out string values. In a raw string literal, backslashes are just backslashes, as long as they are not the last character in the string; most escape sequences do not work in a raw string literal:

>>> r'\test\1\2\3'
'\\test\\1\\2\\3'

Last but not least, if you are creating strings that represent filenames on your Windows system, you could also use forward slashes; most APIs in Window don’t mind and accept both types of slash as separators in the filename:

>>> 'C:/This/is/a/valid/path'
'C:/This/is/a/valid/path'

More Related Contents:

  1. How to handle special cases in my Python code?
  2. Unable to use convert strings into integers for a for loop
  3. User input integer list [duplicate]
  4. Best way to convert string to bytes in Python 3?
  5. How to search and replace text in a file?
  6. TypeError: a bytes-like object is required, not ‘str’ when writing to a file in Python 3
  7. How to use string.replace() in python 3.x
  8. How to convert ‘binary string’ to normal string in Python3?
  9. How do I format a string using a dictionary in python-3.x?
  10. What’s the difference between str.isdigit, isnumeric and isdecimal in python?
  11. Extract Number from String in Python
  12. How to match any string from a list of strings in regular expressions in python?
  13. How do I change the string representation of a Python class? [duplicate]
  14. Removing control characters from a string in python
  15. Safely evaluate simple string equation
  16. How to print like printf in Python3?
  17. How to explain the str.maketrans function in Python 3.6?
  18. Print without b’ prefix for bytes in Python 3
  19. “TypeError: a bytes-like object is required, not ‘str'” when handling file content in Python 3
  20. How can I use f-string with a variable, not with a string literal?
  21. String-based enum in Python
  22. FutureWarning: The default value of regex will change from True to False in a future version
  23. How to sort a list of strings in reverse order without using reverse=True parameter?
  24. Deleting consonants from a string in Python
  25. How does str.startswith really work?
  26. Finding the position of a word in a string
  27. Python: for loop – print on the same line [duplicate]
  28. Why do I get “TypeError: not all arguments converted during string formatting” trying to substitute a placeholder like {0} using %?
  29. Why are str.count(”) and len(str) giving different outputs when used on an empty string?
  30. Convert bytes to a string in python 3

Leave a Comment