How do I check if a string is unicode or ascii?

by

In Python 3, all strings are sequences of Unicode characters. There is a bytes type that holds raw bytes.

In Python 2, a string may be of type str or of type unicode. You can tell which using code something like this:

def whatisthis(s):
    if isinstance(s, str):
        print "ordinary string"
    elif isinstance(s, unicode):
        print "unicode string"
    else:
        print "not a string"

This does not distinguish “Unicode or ASCII”; it only distinguishes Python types. A Unicode string may consist of purely characters in the ASCII range, and a bytestring may contain ASCII, encoded Unicode, or even non-textual data.

More Related Contents:

  1. Why doesn’t Python recognize my utf-8 encoded source file?
  2. Python ascii utf unicode
  3. ElementTree and unicode
  4. Convert “\x” escaped string into readable string in python
  5. python encoding utf-8
  6. Python – dealing with mixed-encoding files
  7. UnicodeDecodeError when performing os.walk
  8. Saving utf-8 texts with json.dumps as UTF8, not as \u escape sequence
  9. Why should we NOT use sys.setdefaultencoding(“utf-8”) in a py script?
  10. Working with UTF-8 encoding in Python source [duplicate]
  11. How to remove \xa0 from string in Python?
  12. u’\ufeff’ in Python string
  13. Url decode UTF-8 in Python
  14. Windows cmd encoding change causes Python crash
  15. Why does Python print unicode characters when the default encoding is ASCII?
  16. Get a list of all the encodings Python can encode to
  17. How to convert a file to utf-8 in Python?
  18. How to convert a string to utf-8 in Python
  19. General Unicode/UTF-8 support for csv files in Python 2.6
  20. MySQL “incorrect string value” error when save unicode string in Django
  21. How to correctly parse UTF-8 encoded HTML to Unicode strings with BeautifulSoup? [duplicate]
  22. Why declare unicode by string in python?
  23. ‘utf-8’ codec can’t decode byte 0xa0 in position 4276: invalid start byte
  24. Python 3 print() function with Farsi/Arabic characters [duplicate]
  25. Should I use encoding declaration in Python 3?
  26. Python – Unicode to ASCII conversion
  27. Python DictWriter writing UTF-8 encoded CSV files
  28. Saving UTF-8 texts with json.dumps as UTF-8, not as a \u escape sequence
  29. Convert UTF-16 to UTF-8 and remove BOM?
  30. How does unicodedata.normalize(form, unistr) work?

Leave a Comment