Remove non-utf8 characters from string

by

If you apply utf8_encode() to an already UTF8 string it will return a garbled UTF8 output.

I made a function that addresses all this issues. It´s called Encoding::toUTF8().

You dont need to know what the encoding of your strings is. It can be Latin1 (ISO8859-1), Windows-1252 or UTF8, or the string can have a mix of them. Encoding::toUTF8() will convert everything to UTF8.

I did it because a service was giving me a feed of data all messed up, mixing those encodings in the same string.

Usage:

require_once('Encoding.php'); 
use \ForceUTF8\Encoding;  // It's namespaced now.

$utf8_string = Encoding::toUTF8($mixed_string);

$latin1_string = Encoding::toLatin1($mixed_string);

I’ve included another function, Encoding::fixUTF8(), which will fix every UTF8 string that looks garbled product of having been encoded into UTF8 multiple times.

Usage:

require_once('Encoding.php'); 
use \ForceUTF8\Encoding;  // It's namespaced now.

$utf8_string = Encoding::fixUTF8($garbled_utf8_string);

Examples:

echo Encoding::fixUTF8("Fédération Camerounaise de Football");
echo Encoding::fixUTF8("Fédération Camerounaise de Football");
echo Encoding::fixUTF8("FÃÂédÃÂération Camerounaise de Football");
echo Encoding::fixUTF8("Fédération Camerounaise de Football");

will output:

Fédération Camerounaise de Football
Fédération Camerounaise de Football
Fédération Camerounaise de Football
Fédération Camerounaise de Football

Download:

https://github.com/neitanod/forceutf8

More Related Contents:

  1. Turn Plain Text URLs into Active Links using PHP [closed]
  2. How to find value between commas
  3. How to validate an email address in PHP
  4. How to validate an Email in PHP?
  5. Remove all special characters from a string [duplicate]
  6. php regex to match outside of html tags
  7. PHP: Regex to ignore escaped quotes within quotes
  8. Get content between two strings PHP
  9. How to remove non-alphanumeric characters?
  10. What does the “[^][]” regex mean?
  11. Split camelCase word into words with php preg_match (Regular Expression)
  12. RegExp to strip HTML comments
  13. php sentence boundaries detection [duplicate]
  14. RegEx pattern to get the YouTube video ID from any YouTube URL
  15. Get Youtube Video ID from html code with PHP
  16. How to add hyphen to regex
  17. Regular Expression to collect everything after the last /
  18. Extra backslash needed in PHP regexp pattern
  19. What is the use of ‘\G’ anchor in regex?
  20. PHP regular expression for strong password validation [duplicate]
  21. Change single variable value in querystring [closed]
  22. php regex to get string inside href tag
  23. Tilde operator in Regular expressions
  24. Regex / DOMDocument – match and replace text not in a link
  25. Converting Javascript Regex to PHP
  26. Extract floating point numbers from a delimited string in PHP
  27. PHP – detect whitespace between strings
  28. What is the MM/DD/YYYY regular expression and how do I use it in php?
  29. Finding @mentions in string
  30. PHP: Escape RegEx pattern to prevent being applied?

Leave a Comment