UnicodeDecodeError: ‘utf8’ codec can’t decode byte 0x9c

by

http://docs.python.org/howto/unicode.html#the-unicode-type

str = unicode(str, errors="replace")

or

str = unicode(str, errors="ignore")

Note: This will strip out (ignore) the characters in question returning the string without them.

For me this is ideal case since I’m using it as protection against non-ASCII input which is not allowed by my application.

Alternatively: Use the open method from the codecs module to read in the file:

import codecs
with codecs.open(file_name, 'r', encoding='utf-8',
                 errors="ignore") as fdata:

More Related Contents:

  1. ImageMagick not authorized to convert PDF to an image
  2. Take a screenshot via a Python script on Linux
  3. Two versions of python on linux. how to make 2.7 the default
  4. How to get Linux console window width in Python
  5. mysql_config not found when installing mysqldb python interface
  6. Python subprocess.Popen “OSError: [Errno 12] Cannot allocate memory”
  7. Run Python script at startup in Ubuntu
  8. What do I need to read Microsoft Access databases using Python?
  9. How to find the real user home directory using python?
  10. Cannot kill Python script with Ctrl-C
  11. cqlsh connection error: ‘ref() does not take keyword arguments’
  12. Cross-platform space remaining on volume using python
  13. Format of /dev/input/event*
  14. How to get output from subprocess.Popen(). proc.stdout.readline() blocks, no data prints out
  15. Django server killed frequently
  16. Use the default Python rather than the Anaconda installation when called from the terminal
  17. Understanding python subprocess.check_output’s first argument and shell=True [duplicate]
  18. Python script as linux service/daemon
  19. Call to operating system to open url?
  20. How to upgrade Python version to 3.7? [closed]
  21. How to use export with Python on Linux
  22. Listing available devices in python-opencv
  23. Cron job: how to run a script that requires to open display?
  24. Executing command using “su -l” in SSH using Python
  25. Paramiko authentication fails with “Agreed upon ‘rsa-sha2-512’ pubkey algorithm” (and “unsupported public key algorithm: rsa-sha2-512” in sshd log)
  26. What is different between makedirs and mkdir of os?
  27. Python returns length of 2 for single Unicode character string
  28. On linux SUSE or RedHat, how do I load Python 2.7
  29. Multiprocessing: use only the physical cores?
  30. Python read named PIPE

Leave a Comment