High memory consumption with Enumerable.Range?

by

This probably relates to the doubling algorithm used to resize the backing buffer when adding to a list. When you allocate as an array, the length of that is known, and can be queried by checking for IList[<T>] and/or ICollection[<T>]; thus it can allocate a single array, right-sized the first time, and then just block-copy the contents.

With the sequence this is not possible (the sequence does not expose the length in any accessible way); thus it must instead fall back to “keep filling up the buffer; if full, double it and copy”.

Obviously this needs approx double the memory.

An interesting test would be:

var list = new List<int>(10000000);
list.AddRange(Enumerable.Range(1, 10000000));

This will allocate the right size initially, while still using the sequence.

tl;dr; the constructor, when passed a sequence, first checks to see if it can obtain the length by casting to a well-known interface.

More Related Contents:

  1. Prevent duplicates from array, based on condition [closed]
  2. Linq: help me to make this work
  3. When to use .First and when to use .FirstOrDefault with LINQ?
  4. printing all contents of array in C#
  5. What guarantees are there on the run-time complexity (Big-O) of LINQ methods?
  6. Convert string[] to int[] in one line of code using LINQ
  7. LINQ – Left Join, Group By, and Count
  8. Attempted to read or write protected memory. This is often an indication that other memory is corrupt
  9. Func with out parameter
  10. LINQ: Not Any vs All Don’t
  11. How to check if IEnumerable is null or empty?
  12. What is the Efficiency and Performance of LINQ and Lambda Expression in .Net?
  13. LINQ Inner-Join vs Left-Join
  14. DISTINCT() and ORDERBY issue
  15. How to Get XML Node from XDocument
  16. How to take all but the last element in a sequence using LINQ?
  17. Use linq to generate direct update without select
  18. Cannot implicitly convert type ‘System.Collections.Generic.IEnumerable’ to ‘System.Collections.Generic.List
  19. Is there an IEnumerable implementation that only iterates over it’s source (e.g. LINQ) once?
  20. Find substring in a list of strings
  21. Initial capacity of collection types, e.g. Dictionary, List
  22. Get List element position in c# using LINQ
  23. Linq – What is the quickest way to find out deferred execution or not?
  24. Linq style “For Each” [duplicate]
  25. How to do an “in” query in entity framework?
  26. LINQ: Add RowNumber Column
  27. Keep Getting ‘The LINQ expression node type ‘Invoke’ is not supported in LINQ to Entities’ Exception
  28. Linq Query keeps throwing “Unable to create a constant value of type System.Object….”, Why?
  29. How to include() nested child entity in linq
  30. LINQ Query to Convert string to datetime

Leave a Comment