Working with UTF-8 encoding in Python source [duplicate]

by

In Python 3, UTF-8 is the default source encoding (see PEP 3120), so unicode characters can be used anywhere.

In Python 2, you can declare in the source code header:

# -*- coding: utf-8 -*-
....

It is described in the PEP 0263:

Then you can use UTF-8 in strings:

# -*- coding: utf-8 -*-

u = 'idzie wąż wąską dróżką'
uu = u.decode('utf8')
s = uu.encode('cp1250')
print(s)

In addition, it may be worth verifying that your text editor properly encodes your code in UTF-8. Otherwise, you may have invisible characters that are not interpreted as UTF-8.

More Related Contents:

  1. Changing default encoding of Python?
  2. Why should we NOT use sys.setdefaultencoding(“utf-8”) in a py script?
  3. Reading a UTF8 CSV file with Python
  4. Url decode UTF-8 in Python
  5. Convert Unicode to ASCII without errors in Python
  6. Write to UTF-8 file in Python
  7. Get a list of all the encodings Python can encode to
  8. How to convert a file to utf-8 in Python?
  9. Dangers of sys.setdefaultencoding(‘utf-8’)
  10. How do I check if a string is unicode or ascii?
  11. How to print UTF-8 encoded text to the console in Python < 3?
  12. How to write UTF-8 in a CSV file
  13. Why doesn’t Python recognize my utf-8 encoded source file?
  14. Why declare unicode by string in python?
  15. ‘utf-8’ codec can’t decode byte 0xa0 in position 4276: invalid start byte
  16. Should I use encoding declaration in Python 3?
  17. Python ascii utf unicode
  18. ElementTree and unicode
  19. python 3 open() default encoding
  20. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xc3 in position 23: ordinal not in range(128)
  21. Why does this Python program send empty emails when I encode it with utf-8? [duplicate]
  22. What encoding does open() use by default?
  23. Changing the “locale preferred encoding” in Python 3 in Windows
  24. Convert “\x” escaped string into readable string in python
  25. python encoding utf-8
  26. Python – dealing with mixed-encoding files
  27. Python 3 CSV file giving UnicodeDecodeError: ‘utf-8’ codec can’t decode byte error when I print
  28. UnicodeDecodeError when performing os.walk
  29. Bytes in a unicode Python string
  30. UTF-8 HTML and CSS files with BOM (and how to remove the BOM with Python)

Leave a Comment