Why doesn’t Python recognize my utf-8 encoded source file?

by

The encoding your terminal is using doesn’t support that character:

>>> '\xdf'.encode('cp866')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.3/lib/python3.3/encodings/cp866.py", line 12, in encode
    return codecs.charmap_encode(input,errors,encoding_map)
UnicodeEncodeError: 'charmap' codec can't encode character '\xdf' in position 0: character maps to <undefined>

Python is handling it just fine, it’s your output encoding that cannot handle it.

You can try using chcp 65001 in the Windows console to switch your codepage; chcp is a windows command line command to change code pages.

Mine, on OS X (using UTF-8) can handle it just fine:

>>> print('\xdf')
ß

More Related Contents:

  1. How do I check if a string is unicode or ascii?
  2. Python 3 print() function with Farsi/Arabic characters [duplicate]
  3. Should I use encoding declaration in Python 3?
  4. Python 3: How to specify stdin encoding
  5. Python ascii utf unicode
  6. ElementTree and unicode
  7. Changing the “locale preferred encoding” in Python 3 in Windows
  8. Convert “\x” escaped string into readable string in python
  9. python encoding utf-8
  10. Python – dealing with mixed-encoding files
  11. Python 3 CSV file giving UnicodeDecodeError: ‘utf-8’ codec can’t decode byte error when I print
  12. UnicodeDecodeError when performing os.walk
  13. Unicode (UTF-8) reading and writing to files in Python
  14. Normalizing Unicode
  15. Python and BeautifulSoup encoding issues [duplicate]
  16. Let JSON object accept bytes or let urlopen output strings
  17. Dangers of sys.setdefaultencoding(‘utf-8’)
  18. How to convert a string to utf-8 in Python
  19. NameError: global name ‘unicode’ is not defined – in Python 3
  20. General Unicode/UTF-8 support for csv files in Python 2.6
  21. printing UTF-8 in Python 3 using Sublime Text 3
  22. MySQL “incorrect string value” error when save unicode string in Django
  23. How to print UTF-8 encoded text to the console in Python < 3?
  24. UnicodeEncodeError: ‘ascii’ codec can’t encode character at special name [duplicate]
  25. How to make unicode string with python3
  26. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xc3 in position 23: ordinal not in range(128)
  27. How to detect string byte encoding?
  28. Switching to Python 3 causing UnicodeDecodeError
  29. requests.get returns 403 while the same url works in browser
  30. SQLite, python, unicode, and non-utf data

Leave a Comment