Detect encoding and make everything UTF-8

by

If you apply utf8_encode() to an already UTF-8 string, it will return garbled UTF-8 output.

I made a function that addresses all this issues. It´s called Encoding::toUTF8().

You don’t need to know what the encoding of your strings is. It can be Latin1 (ISO 8859-1), Windows-1252 or UTF-8, or the string can have a mix of them. Encoding::toUTF8() will convert everything to UTF-8.

I did it because a service was giving me a feed of data all messed up, mixing UTF-8 and Latin1 in the same string.

Usage:

require_once('Encoding.php');
use \ForceUTF8\Encoding;  // It's namespaced now.

$utf8_string = Encoding::toUTF8($utf8_or_latin1_or_mixed_string);

$latin1_string = Encoding::toLatin1($utf8_or_latin1_or_mixed_string);

Download:

https://github.com/neitanod/forceutf8

I’ve included another function, Encoding::fixUFT8(), which will fix every UTF-8 string that looks garbled.

Usage:

require_once('Encoding.php');
use \ForceUTF8\Encoding;  // It's namespaced now.

$utf8_string = Encoding::fixUTF8($garbled_utf8_string);

Examples:

echo Encoding::fixUTF8("Fédération Camerounaise de Football");
echo Encoding::fixUTF8("Fédération Camerounaise de Football");
echo Encoding::fixUTF8("FÃÂédÃÂération Camerounaise de Football");
echo Encoding::fixUTF8("Fédération Camerounaise de Football");

will output:

Fédération Camerounaise de Football
Fédération Camerounaise de Football
Fédération Camerounaise de Football
Fédération Camerounaise de Football

I’ve transformed the function (forceUTF8) into a family of static functions on a class called Encoding. The new function is Encoding::toUTF8().

More Related Contents:

  1. PHP messing with HTML Charset Encoding
  2. How do I remove  from the beginning of a file?
  3. How can I get a hex dump of a string in PHP?
  4. PHP DOMDocument loadHTML not encoding UTF-8 correctly
  5. How to replace Microsoft-encoded quotes in PHP
  6. PHP: Convert any string to UTF-8 without knowing the original character set, or at least try
  7. UTF-8 BOM signature in PHP files
  8. PHP output showing little black diamonds with a question mark
  9. Setting the PHP default encoding to UTF-8
  10. How can I write a file in UTF-8 format?
  11. Convert latin1 characters on a UTF8 table into UTF8
  12. Convert utf8-characters to iso-88591 and back in PHP
  13. Error: “Input is not proper UTF-8, indicate encoding !” using PHP’s simplexml_load_string
  14. PHP json encode – Malformed UTF-8 characters, possibly incorrectly encoded [duplicate]
  15. Getting ’ instead of an apostrophe(‘) in PHP
  16. converting a number base 10 to base 62 (a-zA-Z0-9)
  17. dompdf character encoding UTF-8
  18. How to handle user input of invalid UTF-8 characters
  19. json_encode() non utf-8 strings?
  20. Detect file encoding in PHP
  21. How can I detect a malformed UTF-8 string in PHP?
  22. UTF-8 safe equivalent of ord or charCodeAt() in PHP
  23. utf-8 special characters not displaying [duplicate]
  24. Replacing invalid UTF-8 characters by question marks, mbstring.substitute_character seems ignored
  25. Ensuring valid UTF-8 in PHP
  26. UTF-8 not working in HTML forms
  27. Decoding numeric html entities via PHP
  28. UTF8 Filenames in PHP and Different Unicode Encodings
  29. How do I detect if have to apply UTF-8 decode or encode on a string?
  30. PHP json_encode json_decode UTF-8

Leave a Comment