php readdir problem with japanese language file name

by

I can’t speak definitively for PHP, but I suspect it’s the same basic problem as with Python 2 had (before later adding special support for Unicode string filenames).

My belief is that PHP is dealing with filenames using the standard C library ‘open’-et-al functions, which are byte-based. On Windows (NT) these try to encode the real Unicode filename using the system codepage. That might be cp1252 (similar to ISO-8859-1) for Western machines, or cp932 (similar to Shift-JIS) on Japanese machines. For any characters that don’t exist in the system codepage you will get a ‘?’ character, and you’ll be unable to refer to that file.

To get around this problem PHP would have to do the same as Python 3.0 and start using Unicode strings for filenames (and everything else), using the ‘_wopen’-et-al functions to get native-Unicode access to the filenames under Windows. I expect this will happen in PHP6, but for the moment you’re probably pretty much stuffed. You could change the system codepage to cp932 to get access to the filenames, but you’d still get ‘?’ characters for any other Unicode characters not in Shift-JIS, and in any case you really don’t want to make your application’s internal strings all Shift-JIS as it’s quite a horrible encoding.

If it’s your own scripts choosing how to store files, I’d strongly suggest using simple primary-key-based filenames like ‘4356’ locally, putting the real filename in a database, and serving the files up using rewrites/trailing path parts in the URL. Keeping user-supplied filenames in your own local filenames is difficult and a recipe for security disasters even without having to worry about Unicode.

More Related Contents:

  1. Turning a SQL row into an array
  2. Generating random results by weight in PHP?
  3. Using PHP 5.5’s password_hash and password_verify function
  4. Unable to send email using Gmail SMTP server through PHPMailer, getting error: SMTP AUTH is required for message submission on port 587. How to fix?
  5. How do I prevent mails sent through PHP mail() from going to spam? [duplicate]
  6. I have an array of integers, how do I use each one in a mysql query (in php)? [duplicate]
  7. How to extract text from word file .doc,docx,.xlsx,.pptx php
  8. Ping site and return result in PHP
  9. How to create Helper Methods on Laravel not a Facade
  10. php json_encode not working on arrays partially
  11. PDO closing connection
  12. Why PHP script is not workig in a web browser?
  13. Cannot get the body of email with Gmail PHP API
  14. Check if PHP-page is accessed from an iOS device
  15. Best way to create an empty object in JSON with PHP?
  16. Getting a modified preorder tree traversal model (nested set) into a
  17. Using PHP variables inside HTML tags?
  18. Preventing Caching of CSS Files
  19. Replacing Placeholder Variables in a String
  20. How to destroy the session cookie correctly with PHP?
  21. Detect mobile browser [duplicate]
  22. Password_Hash not working on my PHP login
  23. Accessing Files Relative to Bundle in Symfony2
  24. array_unique vs array_flip
  25. Formatting an SQL timestamp with PHP
  26. Call to undefined method mysqli_result::fetch()
  27. How do I install GD on my windows server version of PHP
  28. PHP image resize on the fly vs storing resized images
  29. Getting basic information from Instagram using PHP
  30. How to remove extension from file name (only real extension!) [duplicate]

Leave a Comment