Why do two identical lists have a different memory footprint?

by

When you write [None] * 10, Python knows that it will need a list of exactly 10 objects, so it allocates exactly that.

When you use a list comprehension, Python doesn’t know how much it will need. So it gradually grows the list as elements are added. For each reallocation it allocates more room than is immediately needed, so that it doesn’t have to reallocate for each element. The resulting list is likely to be somewhat bigger than needed.

You can see this behavior when comparing lists created with similar sizes:

>>> sys.getsizeof([None]*15)
184
>>> sys.getsizeof([None]*16)
192
>>> sys.getsizeof([None for _ in range(15)])
192
>>> sys.getsizeof([None for _ in range(16)])
192
>>> sys.getsizeof([None for _ in range(17)])
264

You can see that the first method allocates just what is needed, while the second one grows periodically. In this example, it allocates enough for 16 elements, and had to reallocate when reaching the 17th.

More Related Contents:

  1. How is Python’s List Implemented?
  2. Are tuples more efficient than lists in Python?
  3. Why can tuples contain mutable items?
  4. list() uses slightly more memory than list comprehension
  5. Accessing the list while being sorted
  6. Tuple or list when using ‘in’ in an ‘if’ clause?
  7. Why does list ask about __len__?
  8. Why does creating a list from a list make it larger?
  9. How does str(list) work?
  10. How to combine lists? (Python) [duplicate]
  11. Split a Pandas column of lists into multiple columns
  12. Getting a map() to return a list in Python 3.x
  13. How do I merge a list of dicts into a single dict?
  14. How to do a recursive sub-folder search and return files in a list?
  15. List of lists into numpy array
  16. Replace values in list using Python [duplicate]
  17. Is there a better way to iterate over two lists, getting one element from each list for each iteration? [duplicate]
  18. Add SUM of values of two LISTS into new LIST
  19. Python – How to check list monotonicity
  20. Using an index to get an item
  21. Some built-in to pad a list in python
  22. Remove duplicates and original from list
  23. Python – sum values in dictionary
  24. Python 3 range Vs Python 2 range
  25. Appending to 2D lists in Python [duplicate]
  26. Creating sublists [duplicate]
  27. Can’t sort my list because it is NoneType? Simple Python [duplicate]
  28. How to sort a list of dictionaries by a value of the dictionary in Python?
  29. Why Python `Memory Error` with list `append()` lots of RAM left
  30. Store functions in list and call them later [duplicate]

Leave a Comment