UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xc3 in position 23: ordinal not in range(128)

by

You are encoding to UTF-8, then re-encoding to UTF-8. Python can only do this if it first decodes again to Unicode, but it has to use the default ASCII codec:

>>> u'ñ'
u'\xf1'
>>> u'ñ'.encode('utf8')
'\xc3\xb1'
>>> u'ñ'.encode('utf8').encode('utf8')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 0: ordinal not in range(128)

Don’t keep encoding; leave encoding to UTF-8 to the last possible moment instead. Concatenate Unicode values instead.

You can use str.join() (or, rather, unicode.join()) here to concatenate the three values with dashes in between:

nombre = u'-'.join(fabrica, sector, unidad)
return nombre.encode('utf-8')

but even encoding here might be too early.

Rule of thumb: decode the moment you receive the value (if not Unicode values supplied by an API already), encode only when you have to (if the destination API does not handle Unicode values directly).

More Related Contents:

  1. Changing default encoding of Python?
  2. Why should we NOT use sys.setdefaultencoding(“utf-8”) in a py script?
  3. Working with UTF-8 encoding in Python source [duplicate]
  4. Url decode UTF-8 in Python
  5. How to convert a file to utf-8 in Python?
  6. Dangers of sys.setdefaultencoding(‘utf-8’)
  7. How do I check if a string is unicode or ascii?
  8. How to print UTF-8 encoded text to the console in Python < 3?
  9. How to write UTF-8 in a CSV file
  10. Why doesn’t Python recognize my utf-8 encoded source file?
  11. Why declare unicode by string in python?
  12. ‘utf-8’ codec can’t decode byte 0xa0 in position 4276: invalid start byte
  13. Should I use encoding declaration in Python 3?
  14. Python ascii utf unicode
  15. ElementTree and unicode
  16. Why does this Python program send empty emails when I encode it with utf-8? [duplicate]
  17. Changing the “locale preferred encoding” in Python 3 in Windows
  18. Convert “\x” escaped string into readable string in python
  19. python encoding utf-8
  20. Python – dealing with mixed-encoding files
  21. Python 3 CSV file giving UnicodeDecodeError: ‘utf-8’ codec can’t decode byte error when I print
  22. UnicodeDecodeError when performing os.walk
  23. Convert UTF-8 with BOM to UTF-8 with no BOM in Python
  24. Get a list of all the encodings Python can encode to
  25. ‘UCS-2’ codec can’t encode characters in position 1050-1050
  26. Python email quoted-printable encoding problem
  27. Python unicode codepoint to unicode character
  28. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xd1 in position 2: ordinal not in range(128)
  29. How does unicodedata.normalize(form, unistr) work?
  30. UTF-8 HTML and CSS files with BOM (and how to remove the BOM with Python)

Leave a Comment