How can I iterate twice over a given iterator (reuse the data, “reset” the iterator etc.)? Why does iterating twice give a blank result?

by

An iterator can only be consumed once. For example:

lst = [1, 2, 3]
it = iter(lst)

next(it)
# => 1
next(it)
# => 2
next(it)
# => 3
next(it)
# => StopIteration

When the iterator is supplied to a for loop instead, that last StopIteration will cause it to exit the first time. Trying to use the same iterator in another for loop will cause StopIteration again immediately, because the iterator has already been consumed.

A simple way to work around this is to save all the elements to a list (for example, by doing data = list(data)), which can be traversed as many times as needed.

If the iterator would iterate over many elements, however, it’s a better idea to create independent iterators using tee():

import itertools
it1, it2 = itertools.tee(data, 2) # create as many as needed

Now each one can be iterated in turn:

for e in it1:
    print("doing this one time")

for e in it2:
    print("doing this two times")

More Related Contents:

  1. How to iterate through two lists in parallel?
  2. What exactly are iterator, iterable, and iteration?
  3. How to build a basic iterator?
  4. Iterate over all pairs of consecutive items in a list [duplicate]
  5. Circular list iterator in Python
  6. How can I iterate through two lists in parallel?
  7. Getting number of elements in an iterator in Python
  8. What are iterator, iterable, and iteration?
  9. How to read file N lines at a time?
  10. What’s the shortest way to count the number of items in a generator/iterator?
  11. Update row values where certain condition is met in pandas
  12. How do I iterate through two lists in parallel?
  13. Skip multiple iterations in loop
  14. Is there an expression for an infinite iterator?
  15. What does “three dots” in Python mean when indexing what looks like a number?
  16. When is not a good time to use python generators?
  17. Making a python iterator go backwards?
  18. python groupby behaviour?
  19. split a generator/iterable every n items in python (splitEvery)
  20. cleanest way to call one function on a list of items
  21. Iterate over the lines of a string
  22. Performance Advantages to Iterators?
  23. has_next in Python iterators?
  24. How to iterate across lines in two files simultaneously?
  25. How to read one single line of csv data in Python?
  26. Why can’t I iterate twice over the same iterator? How can I “reset” the iterator or reuse the data?
  27. Proper way to reset csv.reader for multiple iterations?
  28. Pass multiple parameters to concurrent.futures.Executor.map?
  29. How do I re-map python dict keys
  30. How can I count the number of items in an arbitrary iterable (such as a generator)?

Leave a Comment