Convert Unicode to ASCII without errors in Python

by 
>>> u'aあä'.encode('ascii', 'ignore')
'a'

Decode the string you get back, using either the charset in the the appropriate meta tag in the response or in the Content-Type header, then encode.

The method encode(encoding, errors) accepts custom handlers for errors. The default values, besides ignore, are:

>>> u'aあä'.encode('ascii', 'replace')
b'a??'
>>> u'aあä'.encode('ascii', 'xmlcharrefreplace')
b'aあä'
>>> u'aあä'.encode('ascii', 'backslashreplace')
b'a\\u3042\\xe4'

See https://docs.python.org/3/library/stdtypes.html#str.encode

More Related Contents:

  1. Bytes in a unicode Python string
  2. Reading a UTF8 CSV file with Python
  3. How to remove \xa0 from string in Python?
  4. Unicode (UTF-8) reading and writing to files in Python
  5. Replace non-ASCII characters with a single space
  6. How can I remove non-ASCII characters but leave periods and spaces?
  7. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xef in position 1
  8. Why does Python print unicode characters when the default encoding is ASCII?
  9. Python UnicodeDecodeError – Am I misunderstanding encode?
  10. Character reading from file in Python
  11. Python & MySql: Unicode and Encoding
  12. Python and BeautifulSoup encoding issues [duplicate]
  13. Write to UTF-8 file in Python
  14. Get a list of all the encodings Python can encode to
  15. Writing UTF-8 String to MySQL with Python
  16. What is the difference between encode/decode?
  17. MySQL “incorrect string value” error when save unicode string in Django
  18. How to print UTF-8 encoded text to the console in Python < 3?
  19. Why doesn’t Python recognize my utf-8 encoded source file?
  20. UnicodeEncodeError: ‘ascii’ codec can’t encode character at special name [duplicate]
  21. How to unquote a urlencoded unicode string in python?
  22. Python 3 print() function with Farsi/Arabic characters [duplicate]
  23. Python ascii utf unicode
  24. Python – Unicode to ASCII conversion
  25. How do I treat an ASCII string as unicode and unescape the escaped characters in it in python?
  26. Saving UTF-8 texts with json.dumps as UTF-8, not as a \u escape sequence
  27. python 3 open() default encoding
  28. Convert “\x” escaped string into readable string in python
  29. Python – dealing with mixed-encoding files
  30. ASCII vs Unicode + UTF-8

Leave a Comment