UTF-8 HTML and CSS files with BOM (and how to remove the BOM with Python)

by

Since you state:

All of my (text) files are currently
stored in UTF-8 with the BOM

then use the ‘utf-8-sig’ codec to decode them:

>>> s = u'Hello, world!'.encode('utf-8-sig')
>>> s
'\xef\xbb\xbfHello, world!'
>>> s.decode('utf-8-sig')
u'Hello, world!'

It automatically removes the expected BOM, and works correctly if the BOM is not present as well.

More Related Contents:

  1. Convert UTF-8 with BOM to UTF-8 with no BOM in Python
  2. Write to UTF-8 file in Python
  3. How to convert a file to utf-8 in Python?
  4. UnicodeDecodeError in Python when reading a file, how to ignore the error and jump to the next line?
  5. how to can i go over a file twice?
  6. Changing default encoding of Python?
  7. open() gives FileNotFoundError/IOError: Errno 2 No such file or directory
  8. How do I get the path and name of the file that is currently executing?
  9. Python & MySql: Unicode and Encoding
  10. Sorting text file by using Python
  11. Skip first couple of lines while reading lines in Python file
  12. Monitoring contents of files/directories? [duplicate]
  13. What is the most efficient way to get first and last line of a text file?
  14. Do I understand os.walk right?
  15. How do I remove/delete a folder that is not empty?
  16. Writing a list to a file with Python, with newlines
  17. How to do virtual file processing?
  18. Getting file size in Python? [duplicate]
  19. How do I concatenate files in Python?
  20. How to get all of the immediate subdirectories in Python
  21. Easiest way to persist a data structure to a file in python?
  22. Python – IOError: [Errno 13] Permission denied:
  23. Python and character normalization
  24. Copy multiple files in Python
  25. Python: read all text file lines in loop
  26. How to upload File in FastAPI, then to Amazon S3 and finally process it?
  27. Creating a new file, filename contains loop variable, python [duplicate]
  28. Who originally invented this type of syntax: -*- coding: utf-8 -*- [duplicate]
  29. What is the difference between .py and .pyc files? [duplicate]
  30. how to count the total number of lines in a text file using python

Leave a Comment