Unicode Processing in C++

by
  • Use ICU for dealing with your data (or a similar library)
  • In your own data store, make sure everything is stored in the same encoding
  • Make sure you are always using your unicode library for mundane tasks like string length, capitalization status, etc. Never use standard library builtins like is_alpha unless that is the definition you want.
  • I can’t say it enough: never iterate over the indices of a string if you care about correctness, always use your unicode library for this.

More Related Contents:

  1. WChars, Encodings, Standards and Portability
  2. What is the difference between _tmain() and main() in C++?
  3. How to convert wstring into string?
  4. Unicode encoding for string literals in C++11
  5. How to print Unicode character in C++?
  6. Is TCHAR still relevant?
  7. What is the Windows equivalent for en_US.UTF-8 locale?
  8. How to open an std::fstream (ofstream or ifstream) with a unicode filename?
  9. What’s “wrong” with C++ wchar_t and wstrings? What are some alternatives to wide characters?
  10. Output Unicode to console Using C++, in Windows
  11. How do you properly use WideCharToMultiByte
  12. Convert CString to const char*
  13. Read Unicode UTF-8 file into wstring
  14. How to convert char* to wchar_t*?
  15. 😃 (and other Unicode characters) in identifiers not allowed by g++
  16. Writing utf16 to file in binary mode
  17. Correctly reading a utf-16 text file into a string without external libraries?
  18. Is a wide character string literal starting with L like L”Hello World” guaranteed to be encoded in Unicode?
  19. C++ & Boost: encode/decode UTF-8
  20. does (w)ifstream support different encodings
  21. Convert a unicode String In C++ To Upper Case
  22. Should I use wchar_t when using UTF-8?
  23. Convert between string, u16string & u32string
  24. Is wchar_t needed for unicode support?
  25. Do C++11 regular expressions work with UTF-8 strings?
  26. Specification of source charset encoding in MSVC++, like gcc “-finput-charset=CharSet”
  27. Inheriting and overriding functions of a std::string?
  28. converting narrow string to wide string
  29. Output Unicode strings in Windows console
  30. How can I cin and cout some unicode text?

Leave a Comment