Unicode encoding for filesystem in Mac OS X not correct in Python?

by

MacOS X uses a special kind of decomposed UTF-8 to store filenames. If you need to e.g. read in filenames and write them to a “normal” UTF-8 file, you must normalize them :

filename = unicodedata.normalize('NFC', unicode(filename, 'utf-8')).encode('utf-8')

from here: https://web.archive.org/web/20120423075412/http://boodebr.org/main/python/all-about-python-and-unicode

More Related Contents:

  1. UnicodeDecodeError: ‘charmap’ codec can’t decode byte X in position Y: character maps to
  2. “OSError: [Errno 17] File exists” when trying to use os.makedirs [duplicate]
  3. u’\ufeff’ in Python string
  4. Writing Unicode text to a text file?
  5. Windows cmd encoding change causes Python crash
  6. How to install PIL with pip on Mac OS?
  7. How to resolve TypeError: can only concatenate str (not “int”) to str [duplicate]
  8. Removing u in list
  9. How to read Unicode input and compare Unicode strings in Python?
  10. Replace string within file contents [duplicate]
  11. Batch Renaming of Files in a Directory
  12. Check whether a path is valid in Python without creating a file at the path’s target
  13. Matplotlib issue on OS X (“ImportError: cannot import name _thread”)
  14. Segmentation fault: 11 in OS X
  15. How to solve “OSError: telling position disabled by next() call”
  16. How can I programmatically change the background in Mac OS X?
  17. An integer is required? open()
  18. Can’t install pygame with pip as there is an error whilst runningvsetup.py bdist_wheel for pygame [duplicate]
  19. UnicodeDecodeError: ‘utf8’ codec can’t decode bytes in position 3-6: invalid data
  20. Python not sorting unicode properly. Strcoll doesn’t help
  21. python-re: How do I match an alpha character
  22. Error “(unicode error) ‘unicodeescape’ codec can’t decode bytes in position 2-3: truncated \UXXXXXXXX escape” [duplicate]
  23. How can I read large text files line by line, without loading them into memory? [duplicate]
  24. Error Installing Psycopg2 on MacOS 10.9.5
  25. Matching only a unicode letter in Python re
  26. Python: How can I replace full-width characters with half-width characters?
  27. pyinstaller No module named pyinstaller
  28. Regex and unicode
  29. Python Unicode string stored as ‘\u84b8\u6c7d\u5730’ in file, how to convert it back to Unicode?
  30. how to count the total number of lines in a text file using python

Leave a Comment