Thanks to the tips given in the two answers I was able to poke around and find some methods for normalizing the different unicode decompositions of a given character. In the situation I was faced with I was accessing files created by a OS X Carbon application. It is a fairly popular application and thus … Read more
For CGI, using print() requires that the correct codec has been set up for output. print() writes to sys.stdout and sys.stdout has been opened with a specific encoding and how that is determined is platform dependent and can differ based on how the script is run. Running your script as a CGI script means you … Read more
You need to use MIME. Add mail headers: MIME-Version: 1.0 Content-Type: text/plain;charset=utf-8 (If you are already using a MIME multipart/alternative to put HTML and text in the same mail, you put the Content-Type: text/plain;charset=utf-8 on the sub-headers of the text part instead.) This is assuming that the encoding you’ll be sending your “international” characters in … Read more
html_entity_decode already does what you’re looking for: $string = ‘’’; echo html_entity_decode($string, ENT_COMPAT, ‘UTF-8′); It will return the character: ’ binary hex: c292 Which is PRIVATE USE TWO (U+0092). As it’s private use, your PHP configuration/version/compile might not return it at all. Also there are some more quirks: But in HTML (other than XHTML, which … Read more
Short Answer: Simply delete or comment out line below, and it will always work, no matter which database encoding is really in use (utf8, latin1, etc): $pdo->exec(‘SET CHARACTER SET utf8’); Long Answer: This is not PDO bug, this is MySQL bug. When actual database encoding is latin1, but you use: SET CHARACTER SET utf8 (or … Read more
MySQL’s utf8 charset is not actually UTF-8, it’s a subset of UTF-8 only supporting the basic plane (characters up to U+FFFF). Most emoji use code points higher than U+FFFF. MySQL’s utf8mb4 is actual UTF-8 which can encode all those code points. Outside of MySQL there’s no such thing as “utf8mb4”, there’s just UTF-8. So: Does … Read more
In your HTML, add this meta tag: <meta http-equiv=”Content-Type” content=”text/html;charset=UTF-8″> Also add this PHP header at top of the script: header(“Content-Type: text/html;charset=UTF-8”); [EDIT]: One more tip is to save the file as UTF-8 without BOM encoding. You can use Notepad++ or any decent editor to do that.
If you know the data is in UTF8 than you want to set up the header. I wrote a solution answering to another tread. The solution is the following: As the UTF-8 byte-order mark is \xef\xbb\xbf we should add it to the document’s header. <?php function writeStringToFile($file, $string){ $f=fopen($file, “wb”); $file=”\xEF\xBB\xBF”.$file; // this is what … Read more