How to change diacritic characters to non-diacritic ones [duplicate]

by

Since no one has ever bothered to post the code to do this, here it is:

    // \p{Mn} or \p{Non_Spacing_Mark}: 
    //   a character intended to be combined with another 
    //   character without taking up extra space 
    //   (e.g. accents, umlauts, etc.). 
    private readonly static Regex nonSpacingMarkRegex = 
        new Regex(@"\p{Mn}", RegexOptions.Compiled);

    public static string RemoveDiacritics(string text)
    {
        if (text == null)
            return string.Empty;

        var normalizedText = 
            text.Normalize(NormalizationForm.FormD);

        return nonSpacingMarkRegex.Replace(normalizedText, string.Empty);
    }

Note: a big reason for needing to do this is when you are integrating to a 3rd party system that only does ascii, but your data is in unicode. This is common. Your options are basically: remove accented characters, or attempt to remove accents from the accented characters to attempt to preserve as much as you can of the original input. Obviously, this is not a perfect solution but it is 80% better than simply removing any character above ascii 127.

More Related Contents:

  1. How do I remove diacritics (accents) from a string in .NET?
  2. MSI vs nuget packages: which are is better for continuous delivery?
  3. Comparing two collections for equality irrespective of the order of items in them
  4. How to do SQL Like % in Linq?
  5. Could not load file or assembly Microsoft.SqlServer.management.sdk.sfc version 11.0.0.0
  6. Case insensitive string compare in LINQ-to-SQL
  7. How can I set the opacity or transparency of a Panel in WinForms?
  8. New asp.net charting controls – will they work with MVC (eventually)?
  9. How can I add a hint text to WPF textbox?
  10. DesignMode with nested Controls
  11. How do you keep user.config settings across different assembly versions in .net?
  12. What is the best implementation for AOP in .Net? [closed]
  13. Calling Console.WriteLine from multiple threads
  14. .NET convert number to string representation (1 to one, 2 to two, etc…)
  15. How to programmatically derive Windows Downloads folder “%USERPROFILE%/Downloads”?
  16. Create a hashcode of two numbers
  17. Is it necessary to add a @ in front of an SqlParameter name?
  18. Accessing imgUr thru OAuth (uploading to user account)
  19. Making DataGridView rows a certain color based on a column value
  20. How can I force .NET to use a local copy of an assembly that’s in the GAC
  21. Json.NET serializing float/double with minimal decimal places, i.e. no redundant “.0”?
  22. HRESULT: 0x80131040: The located assembly’s manifest definition does not match the assembly reference
  23. How does Copy-local work? log4net.dll is not being copied to MyProject output directory
  24. Is .NET’s StringBuilder thread-safe
  25. Coerce a WPF TextBox not working anymore in .NET 4.0
  26. How to edit EXIF data in .NET [closed]
  27. Under what circumstances, we need to call GC.Collect twice
  28. How to wait until remote .NET debugger attached
  29. How does the Licenses.licx based .Net component licensing model work?
  30. The request was aborted: Could not create SSL/TLS secure channel sandbox account

Leave a Comment