Unicode string with diacritics split by chars

by

To do this properly, what you want is the algorithm for working out the grapheme cluster boundaries, as defined in UAX 29. Unfortunately this requires knowledge of which characters are members of which classes, from the Unicode Character Database, and JavaScript doesn’t make that information available(*). So you’d have to include a copy of the UCD with your script, which would make it pretty bulky.

An alternative if you only need to worry about the basic accents used by Latin or Cyrillic would be to take only the Combining Diacritical Marks block (U+0300-U+036F). This would fail for other languages and symbols, but might be enough for what you want to do.

function findGraphemesNotVeryWell(s) {
    var re= /.[\u0300-\u036F]*/g;
    var match, matches= [];
    while (match= re.exec(s))
        matches.push(match[0]);
    return matches;
}

findGraphemesNotVeryWell('Ааа́Ббб́Ввв́Г㥴Дд');
["А", "а", "а́", "Б", "б", "б́", "В", "в", "в́", "Г", "г", "Ґ", "ґ", "Д", "д"]

(*: there might be a way to extract the information by letting the browser render the string, and measuring the positions of selections in it… but it would surely be very messy and difficult to get working cross-browser.)

More Related Contents:

  1. Is there a built in way to convert a comma-separated string to an array?
  2. Split large string in n-size chunks in JavaScript
  3. How can I convert a comma-separated string to an array?
  4. How can I split a string into segments of n characters?
  5. Javascript unicode string, chinese character but no punctuation
  6. Split a string based on multiple delimiters
  7. Javascript string comparison fails when comparing unicode characters
  8. String split returns an array with more elements than expected (empty elements)
  9. javascript and string manipulation w/ utf-16 surrogate pairs
  10. How to count the number of lines of a string in javascript
  11. Regular Expression to get a string between parentheses in Javascript
  12. Insert a string at a specific index
  13. Capitalize words in string [duplicate]
  14. Replace multiple whitespaces with single whitespace in JavaScript string
  15. Is there a JavaScript function that can pad a string to get to a determined length?
  16. How do I check if string contains substring? [duplicate]
  17. javascript regex split produces too many items
  18. Replacing spaces with underscores in JavaScript?
  19. \u200b (Zero width space) characters in my JS code. Where did they come from?
  20. Pass a string by reference in Javascript
  21. How to convert a String containing Scientific Notation to correct Javascript number format
  22. How to convert array into string without comma and separated by space in javascript without concatenation?
  23. javascript for loop counter coming out as string [duplicate]
  24. Split string on the first white space occurrence
  25. Replace multiple characters by one character with regex
  26. Why does String.prototype log it’s object like a standard object, while Array.prototype logs it’s object like a standard array?
  27. How to debug identical strings that do not equal in google app script?
  28. Using Javascript to find most common words in string?
  29. How do you split a javascript string by spaces and punctuation?
  30. How to add spaces between every character in a string?

Leave a Comment