Difference between open and codecs.open in Python

by

Since Python 2.6, a good practice is to use io.open(), which also takes an encoding argument, like the now obsolete codecs.open(). In Python 3, io.open is an alias for the open() built-in. So io.open() works in Python 2.6 and all later versions, including Python 3.4. See docs: http://docs.python.org/3.4/library/io.html

Now, for the original question: when reading text (including “plain text”, HTML, XML and JSON) in Python 2 you should always use io.open() with an explicit encoding, or open() with an explicit encoding in Python 3. Doing so means you get correctly decoded Unicode, or get an error right off the bat, making it much easier to debug.

Pure ASCII “plain text” is a myth from the distant past. Proper English text uses curly quotes, em-dashes, bullets, € (euro signs) and even diaeresis (¨). Don’t be naïve! (And let’s not forget the Façade design pattern!)

Because pure ASCII is not a real option, open() without an explicit encoding is only useful to read binary files.

More Related Contents:

  1. Python, Unicode, and the Windows console
  2. (unicode error) ‘unicodeescape’ codec can’t decode bytes in position 2-3: truncated \UXXXXXXXX escape [duplicate]
  3. Unicode (UTF-8) reading and writing to files in Python
  4. SyntaxError: Non-ASCII character ‘\xa3’ in file when function returns ‘£’
  5. What’s the deal with Python 3.4, Unicode, different languages and Windows?
  6. How to fetch a non-ascii url with urlopen?
  7. Normalizing Unicode
  8. Python and BeautifulSoup encoding issues [duplicate]
  9. Where is Python’s “best ASCII for this Unicode” database? [closed]
  10. How to find out if Python is compiled with UCS-2 or UCS-4?
  11. How to convert a string to utf-8 in Python
  12. NameError: global name ‘unicode’ is not defined – in Python 3
  13. Python unicode equal comparison failed
  14. General Unicode/UTF-8 support for csv files in Python 2.6
  15. MySQL “incorrect string value” error when save unicode string in Django
  16. Any gotchas using unicode_literals in Python 2.6?
  17. How to correctly parse UTF-8 encoded HTML to Unicode strings with BeautifulSoup? [duplicate]
  18. Python – can I detect unicode string language code?
  19. How to make unicode string with python3
  20. How to replace unicode characters in string with something else python?
  21. How can I check if a Python unicode string contains non-Western letters?
  22. How do convert unicode escape sequences to unicode characters in a python string
  23. ElementTree and unicode
  24. Unicode filenames on Windows with Python & subprocess.Popen()
  25. Convert UTF-16 to UTF-8 and remove BOM?
  26. requests.get returns 403 while the same url works in browser
  27. What is internal representation of string in Python 3.x
  28. Regex and unicode
  29. How to send non-English unicode string using HTTP header?
  30. Unable to encode/decode pprint output

Leave a Comment