Writing Unicode text to a text file?

by

Deal exclusively with unicode objects as much as possible by decoding things to unicode objects when you first get them and encoding them as necessary on the way out.

If your string is actually a unicode object, you’ll need to convert it to a unicode-encoded string object before writing it to a file:

foo = u'Δ, Й, ק, ‎ م, ๗, あ, 叶, 葉, and 말.'
f = open('test', 'w')
f.write(foo.encode('utf8'))
f.close()

When you read that file again, you’ll get a unicode-encoded string that you can decode to a unicode object:

f = file('test', 'r')
print f.read().decode('utf8')

More Related Contents:

  1. What is the difference between encode/decode?
  2. What exactly do “u” and “r” string flags do, and what are raw string literals?
  3. UnicodeEncodeError: ‘ascii’ codec can’t encode character u’\xa0′ in position 20: ordinal not in range(128)
  4. What is the best way to remove accents (normalize) in a Python unicode string?
  5. How to get string objects instead of Unicode from JSON?
  6. What exactly do “u” and “r” string prefixes do, and what are raw string literals?
  7. Convert Unicode to ASCII without errors in Python
  8. Why does Python print unicode characters when the default encoding is ASCII?
  9. Python – ‘ascii’ codec can’t decode byte
  10. Get a list of all the encodings Python can encode to
  11. General Unicode/UTF-8 support for csv files in Python 2.6
  12. How to unquote a urlencoded unicode string in python?
  13. Python ascii utf unicode
  14. UnicodeDecodeError: ‘utf8’ codec can’t decode bytes in position 3-6: invalid data
  15. How do convert unicode escape sequences to unicode characters in a python string
  16. Read Unicode characters from command-line arguments in Python 2.x on Windows
  17. Why does ENcoding a string result in a DEcoding error (UnicodeDecodeError)?
  18. Printing a string prints ‘u’ before the string in Python?
  19. Python string to unicode [duplicate]
  20. SQLite, python, unicode, and non-utf data
  21. Bytes in a unicode Python string
  22. How to set sys.stdout encoding in Python 3?
  23. How can I remove non-ASCII characters but leave periods and spaces?
  24. Taking multiple integers on the same line as input from the user in python
  25. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xef in position 1
  26. “Unicode Error “unicodeescape” codec can’t decode bytes… Cannot open text files in Python 3 [duplicate]
  27. Reading Unicode file data with BOM chars in Python
  28. Why is ” > 0 True in Python 2?
  29. How to use a multiprocessing.Manager()?
  30. How do I read an image from a path with Unicode characters?

Leave a Comment