How to avoid tripping over UTF-8 BOM when reading files

by

With ruby 1.9.2 you can use the mode r:bom|utf-8

text_without_bom = nil #define the variable outside the block to keep the data
File.open('file.txt', "r:bom|utf-8"){|file|
  text_without_bom = file.read
}

or

text_without_bom = File.read('file.txt', encoding: 'bom|utf-8')

or 

text_without_bom = File.read('file.txt', mode: 'r:bom|utf-8')

It doesn’t matter, if the BOM is available in the file or not.

You may also use the encoding option with other commands:

text_without_bom = File.readlines(@filename, "r:utf-8")

(You get an array with all lines).

Or with CSV:

require 'csv'
CSV.open(@filename, 'r:bom|utf-8'){|csv|
  csv.each{ |row| p row }
}

More Related Contents:

  1. Best way to require all files from a directory in ruby?
  2. Ruby’s File.open and the need for f.close
  3. How do I remove emoji from string
  4. How to create a file in Ruby
  5. Get names of all files from a folder with Ruby
  6. How to get rid of non-ascii characters in ruby
  7. Nokogiri, open-uri, and Unicode Characters
  8. Ruby 1.9: how can I properly upcase & downcase multibyte strings?
  9. Is there a way to remove the BOM from a UTF-8 encoded file?
  10. Convert unicode codepoint to string character in Ruby
  11. How to check if a directory/file/symlink exists with one command in Ruby
  12. Read, edit, and write a text file line-wise using Ruby
  13. How to determine if a character is a Chinese character
  14. Is this the best way to unescape unicode escape sequences in Ruby?
  15. how to i add objects to an array ? ruby
  16. Converting an array of numbers to characters ruby [closed]
  17. Installed Ruby 1.9.3 with RVM but command line doesn’t show ruby -v
  18. How to select unique elements
  19. Encoding.UTF8.GetString doesn’t take into account the Preamble/BOM
  20. Difference between various variables scopes in ruby
  21. Mac user and getting WARNING: Nokogiri was built against LibXML version 2.7.8, but has dynamically loaded 2.7.3
  22. Valid email address regular expression? [duplicate]
  23. list of ruby operators that can be overridden/implemented
  24. How to run all tests with minitest?
  25. Ruby gsub doesn’t escape single-quotes
  26. Set time zone offset in Ruby
  27. What’s the precedence of ruby’s method call
  28. Natural Language Processing in Ruby [closed]
  29. How to turn a string into a method call? [duplicate]
  30. What is the behavior when using both positional and keyword arguments in Ruby?

Leave a Comment