C# and UTF-16 characters

by

The string class represents a UTF-16 encoded block of text, and each char in a string represents a UTF-16 code value.

Although there is no BCL type that represents a single Unicode code point, there is support for Unicode characters beyond Plane 0 in the form of method overloads taking a string and an index instead of just a char. For example, the static GetUnicodeCategory(char) method on the System.Globalization.CharUnicodeInfo class has a corresponding GetUnicodeCategory(string,int) method that will recognize a simple character or a surrogate pair starting at the specified index.

To iterate through the text elements in a string, you can use the methods on the System.Globalization.StringInfo class. Here, a “text element” corresponds to a single character as displayed on screen. This means that simple characters ("a"), combining characters ("a\u0304\u0308" = “ā̈”), and surrogate pairs ("\uD950\uDF21" = “”) will all be treated as a single text element.

Specifically, the GetTextElementEnumerator static method will allow you to enumerate over each text element in a string (see the linked MSDN page for a code example).

More Related Contents:

  1. Best way to reverse a string
  2. Convert a Unicode string to an escaped ASCII string
  3. Reading Email using Pop3 in C# [closed]
  4. Can’t get Czech characters while generating a PDF
  5. How do I convert Unicode escape sequences to Unicode characters in a .NET string?
  6. How to convert a Unicode character to its ASCII equivalent
  7. How to convert a UTF-8 string into Unicode?
  8. Displaying Arabic characters in C# console application
  9. How can a Label control display Japanese characters properly when the Font used doesn’t support this language?
  10. How can I perform a Unicode aware character by character comparison? [closed]
  11. C# regex to remove non – printable characters, and control characters, in a text that has a mix of many different languages, unicode letters
  12. Characters in string changed after downloading HTML from the internet
  13. Display Unicode characters in converting Html to Pdf
  14. Kanji characters from WebClient html different from actual Kanji in website
  15. How to compare Unicode characters that “look alike”?
  16. How to recognize if a string contains unicode chars?
  17. Get supported characters of a font – in C#
  18. MySQL C# Text Encoding Problems
  19. ASCIIEncoding.ASCII.GetBytes() Returning Unexpected Value
  20. Difference between Char.IsDigit() and Char.IsNumber() in C#
  21. How to output unicode string to RTF (using C#)
  22. Reverse a string with accent chars?
  23. UTF-8 or UTF-16 or UTF-32 or UCS-2
  24. Sending Unicode Messages (such as in Persian and Arabic) in C# using AT Commands through GSM Modem
  25. Unicode characters string
  26. How do I remove emoji characters from a string?
  27. Convert fullwidth to halfwidth
  28. Measuring the length of string containing wide characters
  29. Why is the length of this string longer than the number of characters in it?
  30. Parsing through Arabic / RTL text from left to right

Leave a Comment