Read large txt file multithreaded?

by

You can use the File.ReadLines Method to read the file line-by-line without loading the whole file into memory at once, and the Parallel.ForEach Method to process the lines in multiple threads in parallel:

Parallel.ForEach(File.ReadLines("file.txt"), (line, _, lineNumber) =>
{
    // your code here
});

More Related Contents:

  1. Windows 8/10 and PDF support: Are there APIs? [closed]
  2. How to save leap date ’02/29/2006′ to sql server database? [duplicate]
  3. Creating a blocking Queue in .NET?
  4. Cannot deserialize the JSON array (e.g. [1,2,3]) into type ‘ ‘ because type requires JSON object (e.g. {“name”:”value”}) to deserialize correctly
  5. Why doesn’t C# infer my generic types?
  6. HttpWebRequest using Basic authentication
  7. LINQ Contains Case Insensitive
  8. Is there any benefit of using an Object Initializer?
  9. Using the iterator variable of foreach loop in a lambda expression – why fails?
  10. What’s the difference between Bitmap.Clone() and new Bitmap(Bitmap)?
  11. Suppressing “warning CS4014: Because this call is not awaited, execution of the current method continues…”
  12. Where does error CS0433 “Type ‘X’ already exists in both A.dll and B.dll ” come from?
  13. Regex that accepts only numbers (0-9) and NO characters [duplicate]
  14. How do I get the full url of the page I am on in C#
  15. Struggling trying to get cookie out of response with HttpClient in .net 4.5
  16. “async Task then await Task” vs “Task then return task” [duplicate]
  17. Detect if PDF file is correct (header PDF) [closed]
  18. How to read and write ID3 tags to an MP3 in C#? [closed]
  19. C# reflection – load assembly and invoke a method if it exists
  20. Basic Simple Asp.net + jQuery + JSON example
  21. Passing parameters to XSLT Stylesheet via .NET
  22. Additional Setup in Visual Studio Installer Projects
  23. Exposing Property as Variant in .NET for Interop
  24. string to variable name
  25. named String.Format, is it possible?
  26. How to set the test case sequence in xUnit
  27. Working with SAML 2.0 in C# .NET 4.5
  28. How can I use Html.DisplayFor inside of an iterator?
  29. Read from App.config in a Class Library project
  30. How to pass string value from one form to another form’s load event in C #

Leave a Comment