What you are looking for are Unicode properties. e.g. \p{L} is any kind of letter from any language So a regex to match such a Chinese word could be something like \p{L}+ There are many such properties, for more details see regular-expressions.info Another option is to use the modifier Pattern.UNICODE_CHARACTER_CLASS In Java 7 there is … Read more
The problem is due to some R-Windows special behaviour (using the default system coding / or using some system write functions; I do not know the specifics but the behaviour is actually known) To write text UTF8 encoding on Windows one has to use the useBytes=T options in functions like writeLines or readLines: txt <- … Read more
May be you would find a complete list through the CJK Unicode FAQ (which does include “Chinese, Japanese, and Korean” characters) The “East Asian Script” document does mention: Blocks Containing Han Ideographs Han ideographic characters are found in five main blocks of the Unicode Standard, as shown in Table 12-2 Table 12-2. Blocks Containing Han … Read more