“UnicodeEncodeError: ‘ascii’ codec can’t encode character”

by

You’re trying to convert unicode to ascii in “strict” mode:

>>> help(str.encode)
Help on method_descriptor:

encode(...)
    S.encode([encoding[,errors]]) -> object

    Encodes S using the codec registered for encoding. encoding defaults
    to the default encoding. errors may be given to set a different error
    handling scheme. Default is 'strict' meaning that encoding errors raise
    a UnicodeEncodeError. Other possible values are 'ignore', 'replace' and
    'xmlcharrefreplace' as well as any other name registered with
    codecs.register_error that is able to handle UnicodeEncodeErrors.

You probably want something like one of the following: 

s = u'Protection™'

print s.encode('ascii', 'ignore')    # removes the ™
print s.encode('ascii', 'replace')   # replaces with ?
print s.encode('ascii','xmlcharrefreplace') # turn into xml entities
print s.encode('ascii', 'strict')    # throw UnicodeEncodeErrors

More Related Contents:

  1. (grep) Regex to match non-ASCII characters?
  2. How do I grep for all non-ASCII characters?
  3. How to match Cyrillic characters with a regular expression
  4. Regular Expression Arabic characters and numbers only
  5. Use regular expression to match ANY Chinese character in utf-8 encoding
  6. Unicode Regex; Invalid XML characters
  7. matching unicode characters in python regular expressions
  8. How do I remove all non-ASCII characters with regex and Notepad++?
  9. Does \w match all alphanumeric characters defined in the Unicode standard?
  10. Is There a Way to Match Any Unicode Alphabetic Character?
  11. subdomain htaccess rediect with query string
  12. Can regular expressions be used to match nested patterns? [duplicate]
  13. Regex to pick characters outside of pair of quotes
  14. Find ‘word’ not followed by a certain character
  15. Regex to split a CSV
  16. How can I match nested brackets using regex?
  17. Negative matching using grep (match lines that do not contain foo)
  18. Remove all special characters from a string in R?
  19. Matching all words except one
  20. Oracle REGEXP_LIKE and word boundaries
  21. Convert dd/mm/yy and dd/mm/yyyy to Dates
  22. Why can’t you use repetition quantifiers in zero-width look behind assertions?
  23. How can I exclude some characters from a class?
  24. What is the difference between \1 and $1 in a Perl regex?
  25. US Phone Number Verification
  26. How can I use a variable for a regex pattern without interpreting meta characters?
  27. Regular Expression for getting everything after last slash [duplicate]
  28. Regex: Get Filename Without Extension in One Shot?
  29. Multiline Regex in PowerShell
  30. Powershell script to remove double quotes from CSV unless comma exists inside double quotes

Leave a Comment