“Unmappable character for encoding UTF-8” error

by

You have encoding problem with your sourcecode file. It is maybe ISO-8859-1 encoded, but the compiler was set to use UTF-8. This will results in errors when using characters, which will not have the same bytes representation in UTF-8 and ISO-8859-1. This will happen to all characters which are not part of ASCII, for example ¬ NOT SIGN.

You can simulate this with the following program. It just uses your line of source code and generates a ISO-8859-1 byte array and decode this “wrong” with UTF-8 encoding. You can see at which position the line gets corrupted. I added 2 spaces at your source code to fit position 74 to fit this to ¬ NOT SIGN, which is the only character, which will generate different bytes in ISO-8859-1 encoding and UTF-8 encoding. I guess this will match indentation with the real source file.

 String reg = "      String reg = \"^(?=.*[0-9])(?=.*[a-z])(?=.*[A-Z])(?=.*[~#;:?/@&!\"'%*=¬.,-])(?=[^\\s]+$).{8,24}$\";";
 String corrupt=new String(reg.getBytes("ISO-8859-1"),"UTF-8");
 System.out.println(corrupt+": "+corrupt.charAt(74));
 System.out.println(reg+": "+reg.charAt(74));

which results in the following output (messed up because of markup):

String reg = “^(?=.[0-9])(?=.[a-z])(?=.[A-Z])(?=.[~#;:?/@&!”‘%*=�.,-])(?=[^\s]+$).{8,24}$”;: �

String reg = “^(?=.[0-9])(?=.[a-z])(?=.[A-Z])(?=.[~#;:?/@&!”‘%*=¬.,-])(?=[^\s]+$).{8,24}$”;: ¬

See “live” at https://ideone.com/ShZnB

To fix this, save the source files with UTF-8 encoding.

More Related Contents:

  1. How to get UTF-8 working in Java webapps?
  2. What is the Java’s internal represention for String? Modified UTF-8? UTF-16?
  3. Binary to text in Java
  4. How to configure encoding in Maven?
  5. Java properties UTF-8 encoding in Eclipse
  6. “unmappable character for encoding” warning in Java
  7. Java – Convert String to valid URI object
  8. Guessing the encoding of text represented as byte[] in Java
  9. IntelliJ IDEA incorrect encoding in console output
  10. File was loaded in the wrong encoding:’UTF-8′ in IntelliJ IDEA
  11. Java BufferedWriter object with utf-8
  12. Java 8 UTF-8 encoding issue (java bug?)
  13. Check if a String is valid UTF-8 encoded in Java
  14. cyrillic in windows Console(java) System.out.println();
  15. HttpServletRequest UTF-8 Encoding [duplicate]
  16. Should source code be saved in UTF-8 format
  17. Why is Java BufferedReader() not reading Arabic and Chinese characters correctly?
  18. Unable to print russian characters
  19. Producing valid XML with Java and UTF-8 encoding
  20. Java Encode file to Base64 string To match with other encoded string
  21. How do I tell Maven to use the latest version of a dependency?
  22. Encode String to UTF-8
  23. How to convert Strings to and from UTF8 byte arrays in Java
  24. Make Maven to copy dependencies into target/lib
  25. Warning – Build path specifies execution environment J2SE-1.4
  26. Java FileReader encoding issue
  27. UTF-8 byte[] to String
  28. Eclipse – java.lang.ClassNotFoundException
  29. Is there anyway to exclude artifacts inherited from a parent POM?
  30. Unable to use Intellij with a generated sources folder

Leave a Comment