Python: How can I replace full-width characters with half-width characters?

by

The built-in unicodedata module can do it:

>>> import unicodedata
>>> foo = u'１２３４５６７８９０'
>>> unicodedata.normalize('NFKC', foo)
u'1234567890'

The “NFKC” stands for “Normalization Form KC [Compatibility Decomposition, followed by Canonical Composition]”, and replaces full-width characters by half-width ones, which are Unicode equivalent.

Note that it also normalizes all sorts of other things at the same time, like separate accent marks and Roman numeral symbols.

More Related Contents:

  1. Python, Unicode, and the Windows console
  2. (unicode error) ‘unicodeescape’ codec can’t decode bytes in position 2-3: truncated \UXXXXXXXX escape [duplicate]
  3. Unicode (UTF-8) reading and writing to files in Python
  4. SyntaxError: Non-ASCII character ‘\xa3’ in file when function returns ‘£’
  5. What’s the deal with Python 3.4, Unicode, different languages and Windows?
  6. How to fetch a non-ascii url with urlopen?
  7. Normalizing Unicode
  8. Python and BeautifulSoup encoding issues [duplicate]
  9. Where is Python’s “best ASCII for this Unicode” database? [closed]
  10. How to find out if Python is compiled with UCS-2 or UCS-4?
  11. How to convert a string to utf-8 in Python
  12. NameError: global name ‘unicode’ is not defined – in Python 3
  13. Python unicode equal comparison failed
  14. General Unicode/UTF-8 support for csv files in Python 2.6
  15. MySQL “incorrect string value” error when save unicode string in Django
  16. Any gotchas using unicode_literals in Python 2.6?
  17. How to correctly parse UTF-8 encoded HTML to Unicode strings with BeautifulSoup? [duplicate]
  18. When should I use ugettext_lazy?
  19. Get unicode code point of a character using Python
  20. How can I check if a Python unicode string contains non-Western letters?
  21. How do convert unicode escape sequences to unicode characters in a python string
  22. ElementTree and unicode
  23. Unicode filenames on Windows with Python & subprocess.Popen()
  24. Convert UTF-16 to UTF-8 and remove BOM?
  25. requests.get returns 403 while the same url works in browser
  26. Python string to unicode [duplicate]
  27. How to bind a text domain to a local folder for gettext under GTK3
  28. Set encoding in Python 3 CGI scripts
  29. Python 3 chokes on CP-1252/ANSI reading
  30. How to make print() output UTF-8 in Python 3.0?

Leave a Comment