C++ & Boost: encode/decode UTF-8

by

Thanks everyone, but ultimately I resorted to http://utfcpp.sourceforge.net/ — it’s a header-only library that’s very lightweight and easy to use. I’m sharing a demo code here, should anyone find it useful:

inline void decode_utf8(const std::string& bytes, std::wstring& wstr)
{
    utf8::utf8to32(bytes.begin(), bytes.end(), std::back_inserter(wstr));
}
inline void encode_utf8(const std::wstring& wstr, std::string& bytes)
{
    utf8::utf32to8(wstr.begin(), wstr.end(), std::back_inserter(bytes));
}

Usage:

wstring ws(L"\u05e9\u05dc\u05d5\u05dd");
string s;
encode_utf8(ws, s);

More Related Contents:

  1. UTF8 to/from wide char conversion in STL
  2. What is the Windows equivalent for en_US.UTF-8 locale?
  3. Read Unicode UTF-8 file into wstring
  4. Should I use wchar_t when using UTF-8?
  5. Do C++11 regular expressions work with UTF-8 strings?
  6. Inheriting and overriding functions of a std::string?
  7. How do I sort a std::vector by the values of a different std::vector?
  8. What is the performance overhead of std::function?
  9. Sorting zipped (locked) containers in C++ using boost or the STL
  10. smart pointers (boost) explained
  11. Using Unicode in C++ source code
  12. Where is Boost.Process?
  13. 😃 (and other Unicode characters) in identifiers not allowed by g++
  14. How to set a timeout on blocking sockets in boost asio?
  15. What are the advantages of boost::noncopyable
  16. How to parse date/time from string?
  17. How to create a UTF-8 string literal in Visual C++ 2008
  18. GCC equivalent of MS’s /bigobj
  19. fatal error LNK1104: cannot open file ‘libboost_system-vc110-mt-gd-1_51.lib’
  20. Using boost thread and a non-static class function
  21. How to use boost preprocessor to generate accessors?
  22. Can I use boost library for crossplatform application executing?
  23. Is-braces-constructible type trait
  24. C++ Function Callbacks: Cannot convert from a member function to a function signature
  25. Calculate rolling / moving average in C++
  26. Making a C++ class a Monitor (in the concurrent sense)
  27. CMake: Project structure with unit tests
  28. How to determine the Boost version on a system?
  29. Using shared_ptr in dll-interfaces
  30. Strange exception throw – assign: Operation not permitted

Leave a Comment