Is it worth using Python’s re.compile?

by

I’ve had a lot of experience running a compiled regex 1000s of times versus compiling on-the-fly, and have not noticed any perceivable difference. Obviously, this is anecdotal, and certainly not a great argument against compiling, but I’ve found the difference to be negligible.

EDIT:
After a quick glance at the actual Python 2.5 library code, I see that Python internally compiles AND CACHES regexes whenever you use them anyway (including calls to re.match()), so you’re really only changing WHEN the regex gets compiled, and shouldn’t be saving much time at all – only the time it takes to check the cache (a key lookup on an internal dict type).

From module re.py (comments are mine):

def match(pattern, string, flags=0):
    return _compile(pattern, flags).match(string)

def _compile(*key):

    # Does cache check at top of function
    cachekey = (type(key[0]),) + key
    p = _cache.get(cachekey)
    if p is not None: return p

    # ...
    # Does actual compilation on cache miss
    # ...

    # Caches compiled regex
    if len(_cache) >= _MAXCACHE:
        _cache.clear()
    _cache[cachekey] = p
    return p

I still often pre-compile regular expressions, but only to bind them to a nice, reusable name, not for any expected performance gain.

More Related Contents:

  1. Regular expression doesn't produce expected result
  2. How t extract last part of a text in python [duplicate]
  3. re.findall behaves weird
  4. Do regular expressions from the re module support word boundaries (\b)?
  5. Python extract pattern matches
  6. Confused about backslashes in regular expressions [duplicate]
  7. Extract part of a regex match
  8. Reversing a regular expression in Python
  9. regex error – nothing to repeat
  10. re.findall not returning full match?
  11. re.sub replace with matched content
  12. re.sub erroring with “Expected string or bytes-like object”
  13. Can’t use ‘\1’ backreference to capture-group in a function call in re.sub() repr expression
  14. Split string based on regex
  15. Python regex, matching pattern over multiple lines.. why isn’t this working?
  16. BeautifulSoup returns empty list when searching by compound class names
  17. What does the “r” in pythons re.compile(r’ pattern flags’) mean?
  18. How do I re.search or re.match on a whole file without reading it all into memory?
  19. Python regex to match dates
  20. regexes: How to access multiple matches of a group? [duplicate]
  21. Do Python regular expressions have an equivalent to Ruby’s atomic grouping?
  22. Finding words after keyword in python [duplicate]
  23. Grep and Python
  24. Regexp to remove specific number of occurrences of character only
  25. re.search() only matches the first occurrence
  26. How to use str.contains() with multiple expressions in pandas dataframes
  27. match dates using python regular expressions
  28. How to Fix JSON Key Values without double-quotes?
  29. python regular expression across multiple lines
  30. How to use regex with optional characters in python?

Leave a Comment