Java 8 UTF-8 encoding issue (java bug?)

by

It is a property of the “Modified UTF-8” encoding to store surrogate pairs (or even unpaired chars of that range) like individual characters. And it’s an error if a decoder claiming to use standard UTF-8 uses “Modified UTF-8”. This seems to have been fixed with Java 8.

You can reliably read such data using a method that is specified to use “Modified UTF-8”:

ByteBuffer bb=ByteBuffer.allocate(array.length+2);
bb.putShort((short)array.length).put(array);
ByteArrayInputStream bis=new ByteArrayInputStream(bb.array());
DataInputStream dis=new DataInputStream(bis);
String str=dis.readUTF();

More Related Contents:

  1. How to get UTF-8 working in Java webapps?
  2. What is the Java’s internal represention for String? Modified UTF-8? UTF-16?
  3. Binary to text in Java
  4. Java properties UTF-8 encoding in Eclipse
  5. “unmappable character for encoding” warning in Java
  6. Java – Convert String to valid URI object
  7. “Unmappable character for encoding UTF-8” error
  8. Guessing the encoding of text represented as byte[] in Java
  9. IntelliJ IDEA incorrect encoding in console output
  10. File was loaded in the wrong encoding:’UTF-8′ in IntelliJ IDEA
  11. Java BufferedWriter object with utf-8
  12. Check if a String is valid UTF-8 encoded in Java
  13. cyrillic in windows Console(java) System.out.println();
  14. HttpServletRequest UTF-8 Encoding [duplicate]
  15. Should source code be saved in UTF-8 format
  16. Why is Java BufferedReader() not reading Arabic and Chinese characters correctly?
  17. Unable to print russian characters
  18. Producing valid XML with Java and UTF-8 encoding
  19. Java Encode file to Base64 string To match with other encoded string
  20. What are functional interfaces used for in Java 8?
  21. Why filter() after flatMap() is “not completely” lazy in Java streams?
  22. What is the equivalent lambda expression for System.out::println
  23. Difference between `Optional.orElse()` and `Optional.orElseGet()`
  24. Generic type inference not working with method chaining?
  25. Java 8: Where is TriFunction (and kin) in java.util.function? Or what is the alternative?
  26. Eclipse + Java 8 support?
  27. Adding a line in a JavaFX chart
  28. Is it possible to cast a Stream in Java 8?
  29. Creating String representation of lambda expression [duplicate]
  30. Why does byteArray have a length of 22 instead of 20?

Leave a Comment