How can I remove the ANSI escape sequences from a string in python

by

Delete them with a regular expression:

import re

# 7-bit C1 ANSI sequences
ansi_escape = re.compile(r'''
    \x1B  # ESC
    (?:   # 7-bit C1 Fe (except CSI)
        [@-Z\\-_]
    |     # or [ for CSI, followed by a control sequence
        \[
        [0-?]*  # Parameter bytes
        [ -/]*  # Intermediate bytes
        [@-~]   # Final byte
    )
''', re.VERBOSE)
result = ansi_escape.sub('', sometext)

or, without the VERBOSE flag, in condensed form:

ansi_escape = re.compile(r'\x1B(?:[@-Z\\-_]|\[[0-?]*[ -/]*[@-~])')
result = ansi_escape.sub('', sometext)

Demo:

>>> import re
>>> ansi_escape = re.compile(r'\x1B(?:[@-Z\\-_]|\[[0-?]*[ -/]*[@-~])')
>>> sometext="ls\r\n\x1b[00m\x1b[01;31mexamplefile.zip\x1b[00m\r\n\x1b[01;31m"
>>> ansi_escape.sub('', sometext)
'ls\r\nexamplefile.zip\r\n'

The above regular expression covers all 7-bit ANSI C1 escape sequences, but not the 8-bit C1 escape sequence openers. The latter are never used in today’s UTF-8 world where the same range of bytes have a different meaning.

If you do need to cover the 8-bit codes too (and are then, presumably, working with bytes values) then the regular expression becomes a bytes pattern like this:

# 7-bit and 8-bit C1 ANSI sequences
ansi_escape_8bit = re.compile(br'''
    (?: # either 7-bit C1, two bytes, ESC Fe (omitting CSI)
        \x1B
        [@-Z\\-_]
    |   # or a single 8-bit byte Fe (omitting CSI)
        [\x80-\x9A\x9C-\x9F]
    |   # or CSI + control codes
        (?: # 7-bit CSI, ESC [ 
            \x1B\[
        |   # 8-bit CSI, 9B
            \x9B
        )
        [0-?]*  # Parameter bytes
        [ -/]*  # Intermediate bytes
        [@-~]   # Final byte
    )
''', re.VERBOSE)
result = ansi_escape_8bit.sub(b'', somebytesvalue)

which can be condensed down to

# 7-bit and 8-bit C1 ANSI sequences
ansi_escape_8bit = re.compile(
    br'(?:\x1B[@-Z\\-_]|[\x80-\x9A\x9C-\x9F]|(?:\x1B\[|\x9B)[0-?]*[ -/]*[@-~])'
)
result = ansi_escape_8bit.sub(b'', somebytesvalue)

For more information, see:

The example you gave contains 4 CSI (Control Sequence Introducer) codes, as marked by the \x1B[ or ESC [ opening bytes, and each contains a SGR (Select Graphic Rendition) code, because they each end in m. The parameters (separated by ; semicolons) in between those tell your terminal what graphic rendition attributes to use. So for each \x1B[....m sequence, the 3 codes that are used are:

  • 0 (or 00 in this example): reset, disable all attributes
  • 1 (or 01 in the example): bold
  • 31: red (foreground)

However, there is more to ANSI than just CSI SGR codes. With CSI alone you can also control the cursor, clear lines or the whole display, or scroll (provided the terminal supports this of course). And beyond CSI, there are codes to select alternative fonts (SS2 and SS3), to send ‘private messages’ (think passwords), to communicate with the terminal (DCS), the OS (OSC), or the application itself (APC, a way for applications to piggy-back custom control codes on to the communication stream), and further codes to help define strings (SOS, Start of String, ST String Terminator) or to reset everything back to a base state (RIS). The above regexes cover all of these.

Note that the above regex only removes the ANSI C1 codes, however, and not any additional data that those codes may be marking up (such as the strings sent between an OSC opener and the terminating ST code). Removing those would require additional work outside the scope of this answer.

More Related Contents:

  1. How to understand regular expression with python?
  2. Why do backslashes appear twice?
  3. Process escape sequences in a string in Python
  4. How to un-escape a backslash-escaped string?
  5. Escape special characters in a Python string
  6. How to write string literals in python without having to escape them?
  7. What does a leading `\x` mean in a Python string `\xaa`
  8. How can I put an actual backslash in a string literal (not use it for an escape sequence)?
  9. Adding backslashes without escaping [duplicate]
  10. Using __str__() in class object n python 3.7 [closed]
  11. Regex not matching all the paranthesis substrings [duplicate]
  12. Split string every nth character?
  13. Converting integer to string in Python
  14. Find the nth occurrence of substring in a string
  15. Get last “column” after .str.split() operation on column in pandas DataFrame
  16. str.strip() strange behavior
  17. How do I change the string representation of a Python class? [duplicate]
  18. Replace special characters in a string in Python
  19. Split string by count of characters
  20. String Replacement Combinations
  21. How do I verify that a string only contains letters, numbers, underscores and dashes? [duplicate]
  22. lower() vs. casefold() in string matching and converting to lowercase
  23. How can I convert string values from a dictionary, into int/float datatypes?
  24. Is there a better way to find if string contains digits? [duplicate]
  25. Fast string array – Cython
  26. Copy text between parentheses in pandas DataFrame column into another column
  27. Splitting a math expression string into tokens in Python
  28. How can I pad a string with spaces from the right and left? [duplicate]
  29. pandas combine two strings ignore nan values
  30. Python replace function [replace once]

Leave a Comment