Encoding.UTF8.GetString doesn’t take into account the Preamble/BOM

by

It looks like this method ignores the BOM (Byte Order Mark), which might be a part of a legitimate binary representation of a UTF8 string, and takes it as a character.

It doesn’t look like it “ignores” it at all – it faithfully converts it to the BOM character. That’s what it is, after all.

If you want to make your code ignore the BOM in any string it converts, that’s up to you to do… or use StreamReader.

Note that if you either use Encoding.GetBytes followed by Encoding.GetString or use StreamWriter followed by StreamReader, both forms will either produce then swallow or not produce the BOM. It’s only when you mix using a StreamWriter (which uses Encoding.GetPreamble) with a direct Encoding.GetString call that you end up with the “extra” character.

More Related Contents:

  1. What’s the difference between UTF-8 and UTF-8 without BOM?
  2. XML – Data At Root Level is Invalid
  3. Read a UTF-8 text file with BOM
  4. C# Unicode string output
  5. WebClient.DownloadString results in mangled characters due to encoding issues, but the browser is OK
  6. Finding out Unicode character name in .Net
  7. TSQL md5 hash different to C# .NET md5
  8. What’s the difference between UTF-8 and UTF-8 with BOM?
  9. LINQ to Entities does not recognize the method
  10. store image in database or in a system file? [closed]
  11. Calling 32bit Code from 64bit Process
  12. Deserializing empty xml attribute value into nullable int property using XmlSerializer
  13. How to modify .NET config files during installation?
  14. Java Unicode encoding
  15. Option Strict On and .NET for VB6 programmers
  16. Why doesn’t ClickOnce in Visual Studio deploy content files from dependent assemblies?
  17. Changing the type of an (Entity Framework) entity that is part of an inheritance hierarchy
  18. Removing .aspx from pages using rewriteModule?
  19. How to print datagridview table with its header in vb.net?
  20. Open .net framework 4.5 project in VS 2022. Is there any workaround?
  21. How can I install .NET framework as a prerequisite using Inno Setup?
  22. Enum is Reference Type or Value Type?
  23. How to package a portable .NET library targeting .NET Core?
  24. .NET, the SqlConnection object, and multi-threading
  25. How to programmatically restart windows explorer process
  26. Regex to match anything but two words
  27. Why are there two incompatible session state types in ASP.NET?
  28. How can I tell whether two .NET DLLs are the same?
  29. Why does BCL GZipStream (with StreamReader) not reliably detect Data Errors with CRC32?
  30. ‘Shadows’ vs. ‘Overrides’ in VB.NET

Leave a Comment