How to make Django slugify work properly with Unicode strings?

by

There is a python package called unidecode that I’ve adopted for the askbot Q&A forum, it works well for the latin-based alphabets and even looks reasonable for greek:

>>> import unidecode
>>> from unidecode import unidecode
>>> unidecode(u'διακριτικός')
'diakritikos'

It does something weird with asian languages:

>>> unidecode(u'影師嗎')
'Ying Shi Ma '
>>>

Does this make sense?

In askbot we compute slugs like so:

from unidecode import unidecode
from django.template import defaultfilters
slug = defaultfilters.slugify(unidecode(input_text))

More Related Contents:

  1. Iterate over model instance field names and values in template
  2. Creating a dynamic choice field
  3. Django, creating a custom 500/404 error page
  4. Reference list item by index within Django template?
  5. django html template can’t find static css and js files
  6. Django TemplateDoesNotExist?
  7. How to call function that takes an argument in a Django template?
  8. MySQL “incorrect string value” error when save unicode string in Django
  9. How do I include image files in Django templates?
  10. How can I get the domain name of my site within a Django template?
  11. django template system, calling a function inside a model
  12. Django: Display Choice Value
  13. How do I perform query filtering in django templates
  14. How do I use Django templates without the rest of Django?
  15. Access request in django custom template tags
  16. How to filter (or replace) unicode characters that would take more than 3 bytes in UTF-8?
  17. How can I check if a Python unicode string contains non-Western letters?
  18. How to redirect with messages to display them in Django Templates?
  19. How do I create a slug in Django?
  20. How to get the domain name of my site within a Django template?
  21. matching query does not exist Error in Django
  22. How to access the user profile in a Django template?
  23. How do I call a Django function on button click?
  24. Sorting related items in a Django template
  25. Remove non-ASCII characters from a string using python / django
  26. Unable to encode/decode pprint output
  27. How to add multiple arguments to my custom template filter in a django template?
  28. “{% extends %}” vs “{% include %}” in Django Templates
  29. How to implement a “back” link on Django Templates?
  30. Override existing Django Template Tags

Leave a Comment