Why does list ask about __len__?

by

See the Rationale section from PEP 424 that introduced __length_hint__ and offers insight on the motivation:

Being able to pre-allocate lists based on the expected size, as estimated by __length_hint__ , can be a significant optimization. CPython has been observed to run some code faster than PyPy, purely because of this optimization being present.

In addition to that, the documentation for object.__length_hint__ verifies the fact that this is purely an optimization feature:

Called to implement operator.length_hint(). Should return an estimated length for the object (which may be greater or less than the actual length). The length must be an integer >= 0. This method is purely an optimization and is never required for correctness.

So __length_hint__ is here because it can result in some nice optimizations.

PyObject_LengthHint, first tries to get a value from object.__len__ (if it is defined) and then tries to see if object.__length_hint__ is available. If neither is there, it returns a default value of 8 for lists.

listextend, which is called from list_init as Eli stated in his answer, was modified according to this PEP to offer this optimization for anything that defines either a __len__ or a __length_hint__.

list isn’t the only one that benefits from this, of course, bytes objects do:

>>> bytes(Foo())
len
getitem 0
...
b'\x00\x01\x04\t\x10\x19'

so do bytearray objects but, only when you extend them:

>>> bytearray().extend(Foo())
len
getitem 0
...

and tuple objects which create an intermediary sequence to populate themselves:

>>> tuple(Foo())
len
getitem 0
...
(0, 1, 4, 9, 16, 25)

If anybody is wandering why exactly 'iter' is printed before 'len' in class Bar and not after as happens with class Foo:

This is because if the object in hand defines an __iter__ Python will first call it to get the iterator, thereby running the print('iter') too. The same doesn’t happen if it falls back to using __getitem__.

More Related Contents:

  1. How is Python’s List Implemented?
  2. Are tuples more efficient than lists in Python?
  3. Why can tuples contain mutable items?
  4. list() uses slightly more memory than list comprehension
  5. Accessing the list while being sorted
  6. Tuple or list when using ‘in’ in an ‘if’ clause?
  7. Why do two identical lists have a different memory footprint?
  8. Why does creating a list from a list make it larger?
  9. How does str(list) work?
  10. Why is “1000000000000000 in range(1000000000000001)” so fast in Python 3?
  11. Transpose/Unzip Function (inverse of zip)?
  12. Python List vs. Array – when to use?
  13. Getting the index of the returned max or min item using max()/min() on a list
  14. How can I iterate through two lists in parallel?
  15. Find and replace string values in list
  16. Pairs from single list
  17. Splitting a list based on a delimiter word
  18. How do you pick “x” number of unique numbers from a list in Python?
  19. Python split string into multiple string [duplicate]
  20. Python passing list as argument
  21. Python Bool and int comparison and indexing on list with boolean values
  22. Identify groups of consecutive numbers in a list
  23. Python: Remove Duplicate Items from Nested list
  24. How to sort multidimensional array by column?
  25. How to sort a 2D list? [closed]
  26. sum each value in a list of tuples
  27. Mapping dictionary value to list
  28. How to change variables fed into a for loop in list form
  29. Length of longest word in a list
  30. list extend() to index, inserting list elements not only to the end

Leave a Comment