How do convert unicode escape sequences to unicode characters in a python string

by

Assuming Python sees the name as a normal string, you’ll first have to decode it to unicode:

>>> name
'Christensen Sk\xf6ld'
>>> unicode(name, 'latin-1')
u'Christensen Sk\xf6ld'

Another way of achieving this:

>>> name.decode('latin-1')
u'Christensen Sk\xf6ld'

Note the “u” in front of the string, signalling it is uncode. If you print this, the accented letter is shown properly:

>>> print name.decode('latin-1')
Christensen Sköld

BTW: when necessary, you can use de “encode” method to turn the unicode into e.g. a UTF-8 string:

>>> name.decode('latin-1').encode('utf-8')
'Christensen Sk\xc3\xb6ld'

More Related Contents:

  1. What exactly do “u” and “r” string flags do, and what are raw string literals?
  2. UnicodeEncodeError: ‘ascii’ codec can’t encode character u’\xa0′ in position 20: ordinal not in range(128)
  3. What is the best way to remove accents (normalize) in a Python unicode string?
  4. How to get string objects instead of Unicode from JSON?
  5. Writing Unicode text to a text file?
  6. What exactly do “u” and “r” string prefixes do, and what are raw string literals?
  7. Why does Python print unicode characters when the default encoding is ASCII?
  8. Python – ‘ascii’ codec can’t decode byte
  9. What is the difference between encode/decode?
  10. General Unicode/UTF-8 support for csv files in Python 2.6
  11. Python ascii utf unicode
  12. UnicodeDecodeError: ‘utf8’ codec can’t decode bytes in position 3-6: invalid data
  13. Read Unicode characters from command-line arguments in Python 2.x on Windows
  14. Why does ENcoding a string result in a DEcoding error (UnicodeDecodeError)?
  15. Printing a string prints ‘u’ before the string in Python?
  16. Python string to unicode [duplicate]
  17. SQLite, python, unicode, and non-utf data
  18. How can I force division to be floating point? Division keeps rounding down to 0?
  19. How can I read large text files line by line, without loading it into memory?
  20. f-strings giving SyntaxError?
  21. Get a list of all the encodings Python can encode to
  22. How can I get 2.x-like sorting behaviour in Python 3.x?
  23. urllib2 read to Unicode
  24. ‘UCS-2’ codec can’t encode characters in position 1050-1050
  25. What does “ mean in Python?
  26. How to make Django slugify work properly with Unicode strings?
  27. Handling \r\n vs \n newlines in python on Mac vs Windows
  28. Unicode identifiers in Python?
  29. Python – dealing with mixed-encoding files
  30. Python the same char not equals

Leave a Comment