UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xd1 in position 2: ordinal not in range(128)

by

Unicode is not equal to UTF-8. The latter is just an encoding for the former.

You are doing it the wrong way around. You are reading UTF-8-encoded data, so you have to decode the UTF-8-encoded String into a unicode string.

So just replace .encode with .decode, and it should work (if your .csv is UTF-8-encoded).

Nothing to be ashamed of, though. I bet 3 in 5 programmers had trouble at first understanding this, if not more 😉

Update:
If your input data is not UTF-8 encoded, then you have to .decode() with the appropriate encoding, of course. If nothing is given, python assumes ASCII, which obviously fails on non-ASCII-characters.

More Related Contents:

  1. MySQL “incorrect string value” error when save unicode string in Django
  2. Python and character normalization
  3. Django -> queryset[index] Index out of range
  4. django.core.exceptions.ImproperlyConfigured: Requested setting INSTALLED_APPS, but settings are not configured. plz help me out plz
  5. How to set environment variables in PyCharm?
  6. How to pull a random record using Django’s ORM?
  7. How do I access the request object or any other variable in a form’s clean() method?
  8. Django 1.7 throws django.core.exceptions.AppRegistryNotReady: Models aren’t loaded yet
  9. How do I perform HTML decoding/encoding using Python/Django?
  10. Dangers of sys.setdefaultencoding(‘utf-8’)
  11. General Unicode/UTF-8 support for csv files in Python 2.6
  12. Get Timezone from City in Python/Django
  13. multiple django sites with apache & mod_wsgi
  14. How can I get the domain name of my site within a Django template?
  15. Django 1.7 – “No migrations to apply” when run migrate after makemigrations
  16. Why declare unicode by string in python?
  17. ‘utf-8’ codec can’t decode byte 0xa0 in position 4276: invalid start byte
  18. Access django models inside of Scrapy
  19. ‘collectstatic’ command fails when WhiteNoise is enabled
  20. ElementTree and unicode
  21. Using Django database layer outside of Django?
  22. Django: How to build a custom form widget?
  23. “_set” in a queryset object in Django
  24. Difference between AbstractUser and AbstractBaseUser in Django?
  25. django apache configuration with WSGIDaemonProcess not working
  26. How to perform OR condition in django queryset?
  27. Django Admin – Disable the ‘Add’ action for a specific model
  28. Override a form in Django admin
  29. Django equivalent of PHP’s form value array/associative array
  30. How to get python-dev for windows?

Leave a Comment