How do you properly use WideCharToMultiByte

by

Here’s a couple of functions (based on Brian Bondy’s example) that use WideCharToMultiByte and MultiByteToWideChar to convert between std::wstring and std::string using utf8 to not lose any data.

// Convert a wide Unicode string to an UTF8 string
std::string utf8_encode(const std::wstring &wstr)
{
    if( wstr.empty() ) return std::string();
    int size_needed = WideCharToMultiByte(CP_UTF8, 0, &wstr[0], (int)wstr.size(), NULL, 0, NULL, NULL);
    std::string strTo( size_needed, 0 );
    WideCharToMultiByte                  (CP_UTF8, 0, &wstr[0], (int)wstr.size(), &strTo[0], size_needed, NULL, NULL);
    return strTo;
}

// Convert an UTF8 string to a wide Unicode String
std::wstring utf8_decode(const std::string &str)
{
    if( str.empty() ) return std::wstring();
    int size_needed = MultiByteToWideChar(CP_UTF8, 0, &str[0], (int)str.size(), NULL, 0);
    std::wstring wstrTo( size_needed, 0 );
    MultiByteToWideChar                  (CP_UTF8, 0, &str[0], (int)str.size(), &wstrTo[0], size_needed);
    return wstrTo;
}

More Related Contents:

  1. UTF8 to/from wide char conversion in STL
  2. Using Unicode in C++ source code
  3. does (w)ifstream support different encodings
  4. Specification of source charset encoding in MSVC++, like gcc “-finput-charset=CharSet”
  5. Inheriting and overriding functions of a std::string?
  6. WChars, Encodings, Standards and Portability
  7. How to convert wstring into string?
  8. Unicode encoding for string literals in C++11
  9. How to print Unicode character in C++?
  10. Is TCHAR still relevant?
  11. What is the Windows equivalent for en_US.UTF-8 locale?
  12. How to open an std::fstream (ofstream or ifstream) with a unicode filename?
  13. What’s “wrong” with C++ wchar_t and wstrings? What are some alternatives to wide characters?
  14. Output Unicode to console Using C++, in Windows
  15. Convert CString to const char*
  16. Read Unicode UTF-8 file into wstring
  17. How to convert char* to wchar_t*?
  18. PowerShell script runs when pasted into the PowerShell window, but not when run from shortcut
  19. Writing utf16 to file in binary mode
  20. Correctly reading a utf-16 text file into a string without external libraries?
  21. C++ & Boost: encode/decode UTF-8
  22. Convert a unicode String In C++ To Upper Case
  23. Should I use wchar_t when using UTF-8?
  24. Convert between string, u16string & u32string
  25. C++ Visual Studio character encoding issues
  26. Is wchar_t needed for unicode support?
  27. converting narrow string to wide string
  28. Output Unicode strings in Windows console
  29. How to convert Platform::String to char*?
  30. How can I cin and cout some unicode text?

Leave a Comment