UnicodeEncodeError: ‘latin-1’ codec can’t encode character

by

I ran into this same issue when using the Python MySQLdb module. Since MySQL will let you store just about any binary data you want in a text field regardless of character set, I found my solution here:

Using UTF8 with Python MySQLdb

Edit: Quote from the above URL to satisfy the request in the first comment…

“UnicodeEncodeError:’latin-1′ codec can’t encode character …”

This is because MySQLdb normally tries to encode everythin to latin-1.
This can be fixed by executing the following commands right after
you’ve etablished the connection:

db.set_character_set('utf8')
dbc.execute('SET NAMES utf8;')
dbc.execute('SET CHARACTER SET utf8;')
dbc.execute('SET character_set_connection=utf8;')

“db” is the result of MySQLdb.connect(), and “dbc” is the result of
db.cursor().

More Related Contents:

  1. Python & MySql: Unicode and Encoding
  2. MySQL “incorrect string value” error when save unicode string in Django
  3. How to filter (or replace) unicode characters that would take more than 3 bytes in UTF-8?
  4. What is the best way to remove accents (normalize) in a Python unicode string?
  5. How to set sys.stdout encoding in Python 3?
  6. How to correct TypeError: Unicode-objects must be encoded before hashing?
  7. Suppress the u’prefix indicating unicode’ in python strings
  8. How can I connect to MySQL in Python 3 on Windows?
  9. Character reading from file in Python
  10. Authentication plugin ‘caching_sha2_password’ is not supported
  11. Python __str__ versus __unicode__
  12. How to disable SQLAlchemy caching?
  13. When to close cursors using MySQLdb
  14. remove unicode emoji using re in python
  15. How do I read an image from a path with Unicode characters?
  16. How to build a flask application around an already existing database?
  17. Python MySql Insert not working
  18. Python ascii utf unicode
  19. What is the best solution for database connection pooling in python?
  20. trapping a MySql warning
  21. latin-1 to ascii
  22. Can’t open Unicode URL with Python
  23. ImportError: No module named ‘MySQL’
  24. python: unicode in Windows terminal, encoding used?
  25. Python 3 UnicodeDecodeError: ‘charmap’ codec can’t decode byte 0x9d
  26. Python returns length of 2 for single Unicode character string
  27. sqlalchemy existing database query
  28. Python issue:Unable to find vcvarsall.bat [duplicate]
  29. Context manager for Python’s MySQLdb
  30. Python 3 chokes on CP-1252/ANSI reading

Leave a Comment