setting a UTF-8 in java and csv file [duplicate]

by

I spent some time but found solution for your problem.

First I opened notepad and wrote the following line: שלום, hello, привет
Then I saved it as file he-en-ru.csv using UTF-8.
Then I opened it with MS excel and everything worked well.

Now, I wrote a simple java program that prints this line to file as following:

    PrintWriter w = new PrintWriter(new OutputStreamWriter(os, "UTF-8"));
    w.print(line);
    w.flush();
    w.close();

When I opened this file using excel I saw “gibrish.”

Then I tried to read content of 2 files and (as expected) saw that file generated by notepad contains 3 bytes prefix: 

    239 EF
    187 BB
    191 BF

So, I modified my code to print this prefix first and the text after that:

    String line = "שלום, hello, привет";
    OutputStream os = new FileOutputStream("c:/temp/j.csv");
    os.write(239);
    os.write(187);
    os.write(191);

    PrintWriter w = new PrintWriter(new OutputStreamWriter(os, "UTF-8"));

    w.print(line);
    w.flush();
    w.close();

And it worked! I opened the file using excel and saw text as I expected.

Bottom line: write these 3 bytes before writing the content. This prefix indicates that the content is in ‘UTF-8 with BOM‘ (otherwise it is just ‘UTF-8 without BOM’).

More Related Contents:

  1. Java equivalent to JavaScript’s encodeURIComponent that produces identical output?
  2. How can I make Notepad to save text in UTF-8 without the BOM?
  3. Convert escaped Unicode character back to actual character
  4. Using PDFBox to write UTF-8 encoded strings to a PDF [duplicate]
  5. Write a file in UTF-8 using FileWriter (Java)?
  6. Difference between UTF-8 and UTF-16?
  7. OpenCSV – How to map selected columns to Java Bean regardless of order?
  8. How to read UTF8 encoded file using RandomAccessFile?
  9. French and Chinese characters are not appearing correctly
  10. How can I iterate through the unicode codepoints of a Java String?
  11. Java properties UTF-8 encoding in Eclipse
  12. General Unicode/UTF-8 support for csv files in Python 2.6
  13. Why is executing Java code in comments with certain Unicode characters allowed?
  14. CSV file with “ID” as first item is corrupt in Excel
  15. String parsing in Java with delimiter tab “\t” using split
  16. Guessing the encoding of text represented as byte[] in Java
  17. Fast CSV parsing
  18. Display an Unicode character on JButton
  19. How to make the Java.awt.Robot type unicode characters? (Is it possible?)
  20. Check if a String is valid UTF-8 encoded in Java
  21. Splitting a csv file with quotes as text-delimiter using String.split()
  22. JSP page without HTML code for exporting data to Excel Sheet
  23. HttpServletRequest UTF-8 Encoding [duplicate]
  24. Unicode characters in app doesn’t show correctly [closed]
  25. Unable to print russian characters
  26. Java PreparedStatement UTF-8 character problem
  27. Exporting SQL query result to csv or Excel
  28. First character of the reading from the text file :  [duplicate]
  29. Calculating length in UTF-8 of Java String without actually encoding it
  30. What is the {L} Unicode category?

Leave a Comment