Remove non-ASCII characters from a string using python / django

by

You can use that the ASCII characters are the first 128 ones, so get the number of each character with ord and strip it if it’s out of range

# -*- coding: utf-8 -*-

def strip_non_ascii(string):
    ''' Returns the string without non ASCII characters'''
    stripped = (c for c in string if 0 < ord(c) < 127)
    return ''.join(stripped)


test = u'éáé123456tgreáé@€'
print test
print strip_non_ascii(test)

Result

éáé123456tgreáé@€
123456tgre@

Please note that @ is included because, well, after all it’s an ASCII character. If you want to strip a particular subset (like just numbers and uppercase and lowercase letters), you can limit the range looking at a ASCII table

EDITED: After reading your question again, maybe you need to escape your HTML code, so all those characters appears correctly once rendered. You can use the escape filter on your templates.

More Related Contents:

  1. Speed up millions of regex replacements in Python 3
  2. Python regex matching Unicode properties
  3. Python string.replace regular expression [duplicate]
  4. How to input a regex in string.replace?
  5. MySQL “incorrect string value” error when save unicode string in Django
  6. remove unicode emoji using re in python
  7. How to make Django slugify work properly with Unicode strings?
  8. How to replace the first occurrence of a regular expression in Python?
  9. How do I specify a range of unicode characters
  10. Mass string replace in python?
  11. matching unicode characters in python regular expressions
  12. How to filter (or replace) unicode characters that would take more than 3 bytes in UTF-8?
  13. How can I check if a Python unicode string contains non-Western letters?
  14. python-re: How do I match an alpha character
  15. Python unicode regular expression matching failing with some unicode characters -bug or mistake?
  16. Unexpected NoReverseMatch error when using include() in urls patterns
  17. Matching only a unicode letter in Python re
  18. How to validate an Email address in Django? [duplicate]
  19. How to use python regex to replace using captured group? [duplicate]
  20. Regex and unicode
  21. Regexp finding longest common prefix of two strings
  22. Unable to encode/decode pprint output
  23. How to add multiple arguments to my custom template filter in a django template?
  24. Python and BeautifulSoup encoding issues [duplicate]
  25. @csrf_exempt does not work on generic view based class
  26. Python – re.findall returns unwanted result
  27. Why Does a Repeated Capture Group Return these Strings?
  28. How do convert unicode escape sequences to unicode characters in a python string
  29. Regex matching – why does this not match and return None?
  30. Static media images are not displaying in Django

Leave a Comment