Using char16_t and char32_t in I/O

by

In the proposal Minimal Unicode support for the standard library (revision 2) it is indicated that there was only support among the Library Working Group for supporting the new character types in strings and codecvt facets. Apparently the majority was opposed to supporing iostream, fstream, facets other than codecvt, and regex.

According to minutes from the Portland meeting in 2006 “the LWG is committed to full support of Unicode, but does not intend to duplicate the library with Unicode character variants of existing library facilities.” I haven’t found any details, however I would guess that the committee feels that the current library interface is inappropriate for Unicode. One possible complaint could be that it was designed with fixed sized characters in mind, but Unicode completely obsoletes that as, while Unicode data can use fixed sized code points, it does not limit characters to single code points.

Personally I think there’s no reason not to standardized the minimal support that’s already provided on various platforms (Windows uses UTF-16 for wchar_t, most Unix platforms use UTF-32). More advanced Unicode support will require new library facilities, but supporting char16_t and char32_t in iostreams and facets won’t get in the way but would enable basic Unicode i/o.

More Related Contents:

  1. Why does reading a record struct fields from std::istream fail, and how can I fix it?
  2. Are there any tricks to use std::cin to initialize a const variable?
  3. Are int8_t and uint8_t intended to be char types?
  4. Why can’t std::ostream be moved?
  5. Why compiler gives the message "call of overloaded function is ambiguous" here in C++11?
  6. program to delete certain text which is predefined in another file from a file in c++
  7. What are rvalues, lvalues, xvalues, glvalues, and prvalues?
  8. How do I print a double value with full precision using cout?
  9. What happens to a detached thread when main() exits?
  10. What are the advantages of using nullptr?
  11. How to detect C++11 support of a compiler with CMake
  12. Why doesn’t C++ have a garbage collector?
  13. How std::bind works with member functions
  14. What is the meaning of “… …” token? i.e. double ellipsis operator on parameter pack
  15. non-class rvalues always have cv-unqualified types
  16. std::vector, default construction, C++11 and breaking changes
  17. Is this C++11 regex error me or the compiler?
  18. What is the reason for not being able to deduce array size from initializer-string in member variable?
  19. Is std::abs(0u) ill-formed?
  20. Compile time triggered range check for std::vector
  21. Static constexpr odr-used or not?
  22. What exactly is streambuf? How do I use it?
  23. C++: Can a macro expand “abc” into ‘a’, ‘b’, ‘c’?
  24. Is there a compiler bug exposed by my implementation of an is_complete type trait?
  25. Do I have to use #include beside ?
  26. When is a const reference better than pass-by-value in C++11?
  27. Why can I call a non-constexpr function inside a constexpr function?
  28. Ad hoc polymorphism and heterogeneous containers with value semantics
  29. Assert that code does NOT compile
  30. Rvalues, lvalues and formal definitions

Leave a Comment