Iterate a list as pair (current, next) in Python

by

Here’s a relevant example from the itertools module docs:

import itertools
def pairwise(iterable):
    "s -> (s0, s1), (s1, s2), (s2, s3), ..."
    a, b = itertools.tee(iterable)
    next(b, None)
    return zip(a, b)

For Python 2, you need itertools.izip instead of zip:

import itertools
def pairwise(iterable):
    "s -> (s0, s1), (s1, s2), (s2, s3), ..."
    a, b = itertools.tee(iterable)
    next(b, None)
    return itertools.izip(a, b)

How this works:

First, two parallel iterators, a and b are created (the tee() call), both pointing to the first element of the original iterable. The second iterator, b is moved 1 step forward (the next(b, None)) call). At this point a points to s0 and b points to s1. Both a and b can traverse the original iterator independently – the izip function takes the two iterators and makes pairs of the returned elements, advancing both iterators at the same pace.

One caveat: the tee() function produces two iterators that can advance independently of each other, but it comes at a cost. If one of the iterators advances further than the other, then tee() needs to keep the consumed elements in memory until the second iterator comsumes them too (it cannot ‘rewind’ the original iterator). Here it doesn’t matter because one iterator is only 1 step ahead of the other, but in general it’s easy to use a lot of memory this way.

And since tee() can take an n parameter, this can also be used for more than two parallel iterators:

def threes(iterator):
    "s -> (s0, s1, s2), (s1, s2, s3), (s2, s3, 4), ..."
    a, b, c = itertools.tee(iterator, 3)
    next(b, None)
    next(c, None)
    next(c, None)
    return zip(a, b, c)

More Related Contents:

  1. How to check which list an element is contained in
  2. How do I get file creation and modification date/times?
  3. (unicode error) ‘unicodeescape’ codec can’t decode bytes in position 2-3: truncated \UXXXXXXXX escape [duplicate]
  4. Select iframe using Python + Selenium
  5. If Python is interpreted, what are .pyc files?
  6. Run function from the command line
  7. What’s the difference between select_related and prefetch_related in Django ORM?
  8. How do I rotate an image around its center using Pygame?
  9. Format a datetime into a string with milliseconds
  10. How to group a list of tuples/objects by similar index/attribute in python?
  11. Rolling Mean on pandas on a specific column
  12. plotting results of hierarchical clustering ontop of a matrix of data in python
  13. Should I be adding the Django migration files in the .gitignore file?
  14. What does model.train() do in PyTorch?
  15. Making Tkinter windows show up in the taskbar
  16. How to use pip on windows behind an authenticating proxy
  17. How can I check if my python object is a number? [duplicate]
  18. What causes the error “_pickle.UnpicklingError: invalid load key, ‘ ‘.”?
  19. “Boolean” operations in Python (ie: the and/or operators)
  20. How do I do simple user input in python? [duplicate]
  21. How do I format a date in Jinja2?
  22. Use Python os.walk to identify a list of files [duplicate]
  23. How to create a new text file using Python
  24. Use a string to call function in Python [duplicate]
  25. Python argparse: Is there a way to specify a range in nargs?
  26. Why is a function/method call in python expensive?
  27. Run a process and kill it if it doesn’t end within one hour
  28. PythonMagick can’t find my pdf files
  29. Creating multiple Excel worksheets using data from a pandas DataFrame
  30. XlsxWriter object save as http response to create download in Django

Leave a Comment