How can I do multiple substitutions using regex?

by

The answer proposed by @nhahtdh is valid, but I would argue less pythonic than the canonical example, which uses code less opaque than his regex manipulations and takes advantage of python’s built-in data structures and anonymous function feature.

A dictionary of translations makes sense in this context. In fact, that’s how the Python Cookbook does it, as shown in this example (copied from ActiveState http://code.activestate.com/recipes/81330-single-pass-multiple-replace/ )

import re 

def multiple_replace(dict, text):
  # Create a regular expression  from the dictionary keys
  regex = re.compile("(%s)" % "|".join(map(re.escape, dict.keys())))

  # For each match, look-up corresponding value in dictionary
  return regex.sub(lambda mo: dict[mo.string[mo.start():mo.end()]], text) 

if __name__ == "__main__": 

  text = "Larry Wall is the creator of Perl"

  dict = {
    "Larry Wall" : "Guido van Rossum",
    "creator" : "Benevolent Dictator for Life",
    "Perl" : "Python",
  } 

  print multiple_replace(dict, text)

So in your case, you could make a dict trans = {"a": "aa", "b": "bb"} and then pass it into multiple_replace along with the text you want translated. Basically all that function is doing is creating one huge regex containing all of your regexes to translate, then when one is found, passing a lambda function to regex.sub to perform the translation dictionary lookup.

You could use this function while reading from your file, for example:

with open("notes.txt") as text:
    new_text = multiple_replace(replacements, text.read())
with open("notes2.txt", "w") as result:
    result.write(new_text)

I’ve actually used this exact method in production, in a case where I needed to translate the months of the year from Czech into English for a web scraping task.

As @nhahtdh pointed out, one downside to this approach is that it is not prefix-free: dictionary keys that are prefixes of other dictionary keys will cause the method to break.

More Related Contents:

  1. Removing contents within brackets in string [duplicate]
  2. How t extract last part of a text in python [duplicate]
  3. Regex not matching all the paranthesis substrings [duplicate]
  4. How to understand regular expression with python?
  5. How to extract numbers from a string in Python?
  6. Is there a simple way to remove multiple spaces in a string?
  7. How to correctly sort a string with a number inside? [duplicate]
  8. Split string on whitespace in Python [duplicate]
  9. Fast punctuation removal with pandas
  10. Python regex – r prefix
  11. How to input a regex in string.replace?
  12. Split a string at uppercase letters
  13. Python regex match OR operator
  14. Find longest repetitive sequence in a string
  15. How to extract an IP address from an HTML string?
  16. Extract a string between double quotes
  17. Regex for existence of some words whose order doesn’t matter
  18. Splitting a string with repeated characters into a list
  19. How would I get everything before a : in a string Python
  20. Python regex: splitting on pattern match that is an empty string
  21. Mass string replace in python?
  22. Remove duplicate chars using regex?
  23. How to remove symbols from a string with Python? [duplicate]
  24. Replace a string located between
  25. Remove Sub String by using Python
  26. FutureWarning: The default value of regex will change from True to False in a future version
  27. How do I verify that a string only contains letters, numbers, underscores and dashes? [duplicate]
  28. How to use str.contains() with multiple expressions in pandas dataframes
  29. Splitting a math expression string into tokens in Python
  30. Adding characters after a certain word in Python using regex

Leave a Comment