Why doesn’t Python’s `re.split()` split on zero-length matches?

by

It’s a design decision that was made, and could have gone either way. Tim Peters made this post to explain:

For example, if you split “abc” by the pattern x*, what do you
expect? The pattern matches (with length 0) at 4 places,
but I bet most people would be surprised to get

[”, ‘a’, ‘b’, ‘c’, ”]

back instead of (as they do get)

[‘abc’]

Some others disagree with him though. Guido van Rossum doesn’t want it changed due to backwards compatibility issues. He did say:

I’m okay with adding a flag to enable this behavior though.

Edit:

There is a workaround posted by Jan Burgy:

>>> s = "Split along words, preserve punctuation!"
>>> re.sub(r"\s+|\b", '\f', s).split('\f')
['', 'Split', 'along', 'words', ',', 'preserve', 'punctuation', '!']

Where '\f' can be replaced by any unused character.

More Related Contents:

  1. Regular expression doesn't produce expected result
  2. How t extract last part of a text in python [duplicate]
  3. re.findall behaves weird
  4. Do regular expressions from the re module support word boundaries (\b)?
  5. Python extract pattern matches
  6. Split a string by spaces — preserving quoted substrings — in Python
  7. Does “\d” in regex mean a digit?
  8. Remove all special characters, punctuation and spaces from string
  9. How to filter rows in pandas by regex
  10. Natural sorting
  11. matching any character including newlines in a Python regex subexpression, not globally
  12. Python, remove all non-alphabet chars from string
  13. Python Regex to find a string in double quotes within a string
  14. Passing a function to re.sub in Python
  15. How to combine multiple regex into single one in python?
  16. ip address validation in python using regex [duplicate]
  17. “Nothing to repeat” from Python regex
  18. Mass string replace in python?
  19. pandas applying regex to replace values
  20. Using a RegEx to match IP addresses
  21. python-re: How do I match an alpha character
  22. Bug in Python Regex? (re.sub with re.MULTILINE)
  23. Unexpected NoReverseMatch error when using include() in urls patterns
  24. Python Regex – How to Get Positions and Values of Matches
  25. How to do CamelCase split in python
  26. re.search() only matches the first occurrence
  27. Python: Replace with regex
  28. Remove non-ASCII characters from a string using python / django
  29. How to strip whitespace from before but not after punctuation in python
  30. re.split() gives empty elements in list

Leave a Comment