How do I convert special UTF-8 chars to their iso-8859-1 equivalent using javascript?

by

Actually, everything is typically stored as Unicode of some kind internally, but lets not go into that. I’m assuming you’re getting the iconic “åäö” type strings because you’re using an ISO-8859 as your character encoding. There’s a trick you can do to convert those characters. The escape and unescape functions used for encoding and decoding query strings are defined for ISO characters, whereas the newer encodeURIComponent and decodeURIComponent which do the same thing, are defined for UTF8 characters.

escape encodes extended ISO-8859-1 characters (UTF code points U+0080-U+00ff) as %xx (two-digit hex) whereas it encodes UTF codepoints U+0100 and above as %uxxxx (%u followed by four-digit hex.) For example, escape("å") == "%E5" and escape("あ") == "%u3042".

encodeURIComponent percent-encodes extended characters as a UTF8 byte sequence. For example, encodeURIComponent("å") == "%C3%A5" and encodeURIComponent("あ") == "%E3%81%82".

So you can do:

fixedstring = decodeURIComponent(escape(utfstring));

For example, an incorrectly encoded character “å” becomes “Ã¥”. The command does escape("Ã¥") == "%C3%A5" which is the two incorrect ISO characters encoded as single bytes. Then decodeURIComponent("%C3%A5") == "å", where the two percent-encoded bytes are being interpreted as a UTF8 sequence.

If you’d need to do the reverse for some reason, that works too:

utfstring = unescape(encodeURIComponent(originalstring));

Is there a way to differentiate between bad UTF8 strings and ISO strings? Turns out there is. The decodeURIComponent function used above will throw an error if given a malformed encoded sequence. We can use this to detect with a great probability whether our string is UTF8 or ISO.

var fixedstring;

try{
    // If the string is UTF-8, this will work and not throw an error.
    fixedstring=decodeURIComponent(escape(badstring));
}catch(e){
    // If it isn't, an error will be thrown, and we can assume that we have an ISO string.
    fixedstring=badstring;
}

More Related Contents:

  1. Detect browser character support in javascript?
  2. Jquery ignores encoding ISO-8859-1
  3. How to have html popup appear over main html page?
  4. jQuery document.getElementById() issue
  5. How can I get jQuery to perform a synchronous, rather than asynchronous, Ajax request?
  6. jQuery Validate Plugin – How to create a simple custom rule?
  7. Asynchronously load images with jQuery
  8. How can I create an Asynchronous function in Javascript?
  9. how to parse a “dd/mm/yyyy” or “dd-mm-yyyy” or “dd-mmm-yyyy” formatted date string using JavaScript or jQuery [duplicate]
  10. How to replace remapColums with remapColumnsByName in free jqgrid
  11. How to create a JQuery Clock / Timer
  12. How to detect chrome and safari browser (webkit)
  13. jQuery jqGrid Show message when an edit row is complete
  14. Open a new javascript window(.open) along with its CSS styling
  15. How to Disable Copy Paste (Browser)
  16. How to ajax-submit a form textarea input from CKEditor?
  17. Resize on div element
  18. window.print() is not printing the whole page
  19. How do I get first element rather than using [0] in jQuery?
  20. Converting an image to base64 in angular 2
  21. Implementing jquery UI autocomplete to show suggestions when you type “@”
  22. Remove ‘All Files’ option from HTML file input
  23. How to delay execution in between the following in my javascript
  24. Use PHP code in external Javascript file
  25. Converting string array to Name/Value object in javascript
  26. Changing cursor to waiting in javascript/jquery
  27. Bootstrap modal hide is not working
  28. Returning value from confirmation dialog using JQuery UI dialog
  29. A non-nested animation sequence in jQuery?
  30. Why do functional pseudos such as :not() and :has() allow quoted arguments?

Leave a Comment