Detect strings with non English characters in Python

by

You can just check whether the string can be encoded only with ASCII characters (which are Latin alphabet + some other characters). If it can not be encoded, then it has the characters from some other alphabet.

Note the comment # -*- coding: ..... It should be there at the top of the python file (otherwise you would receive some error about encoding)

# -*- coding: utf-8 -*-
def isEnglish(s):
    try:
        s.encode(encoding='utf-8').decode('ascii')
    except UnicodeDecodeError:
        return False
    else:
        return True

assert not isEnglish('slabiky, ale liší se podle významu')
assert isEnglish('English')
assert not isEnglish('ގެ ފުރަތަމަ ދެ އަކުރު ކަ')
assert not isEnglish('how about this one : 通 asfަ')
assert isEnglish('?fd4))45s&')

More Related Contents:

  1. Regular expression doesn't produce expected result
  2. How t extract last part of a text in python [duplicate]
  3. re.findall behaves weird
  4. Do regular expressions from the re module support word boundaries (\b)?
  5. Split a string by spaces — preserving quoted substrings — in Python
  6. Does “\d” in regex mean a digit?
  7. Remove all special characters, punctuation and spaces from string
  8. How to filter rows in pandas by regex
  9. Use Python’s string.replace vs re.sub
  10. Natural sorting
  11. Python regular expression re.match, why this code does not work? [duplicate]
  12. matching any character including newlines in a Python regex subexpression, not globally
  13. Python, remove all non-alphabet chars from string
  14. How do I return a string from a regex match in python? [duplicate]
  15. Splitting a string with repeated characters into a list
  16. How to combine multiple regex into single one in python?
  17. ip address validation in python using regex [duplicate]
  18. “Nothing to repeat” from Python regex
  19. Mass string replace in python?
  20. pandas applying regex to replace values
  21. Using a RegEx to match IP addresses
  22. python-re: How do I match an alpha character
  23. Unexpected NoReverseMatch error when using include() in urls patterns
  24. Python Regex – How to Get Positions and Values of Matches
  25. How to do CamelCase split in python
  26. Extract the ‘src’ attribute from an ‘img’ tag using Beautiful Soup
  27. Regular expression to return all characters between two special characters
  28. re.search() only matches the first occurrence
  29. python – regex search and findall
  30. Extracting whole words

Leave a Comment