how to split an iterable in constant-size chunks

by

This is probably more efficient (faster)

def batch(iterable, n=1):
    l = len(iterable)
    for ndx in range(0, l, n):
        yield iterable[ndx:min(ndx + n, l)]

for x in batch(range(0, 10), 3):
    print x

Example using list

data = [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] # list of data 

for x in batch(data, 3):
    print(x)

# Output

[0, 1, 2]
[3, 4, 5]
[6, 7, 8]
[9, 10]

It avoids building new lists.

More Related Contents:

  1. Python: powerset of a given set with generators [duplicate]
  2. Implement pow(x,n)%d with integers only. (without making use of library functions) [duplicate]
  3. How to implement an efficient infinite generator of prime numbers in Python?
  4. Cost of len() function
  5. What’s a good rate limiting algorithm?
  6. Pick N distinct items at random from sequence of unknown length, in only one iteration
  7. Find all combinations of a list of numbers with a given sum
  8. Return in generator together with yield in Python 3.3
  9. Split a generator into chunks without pre-walking it
  10. Why is Bubble Sort implementation looping forever?
  11. Edit Distance in Python
  12. Longest increasing subsequence
  13. heapq with custom compare predicate
  14. Is there a generator version of `string.split()` in Python?
  15. Python random sample with a generator / iterable / iterator
  16. Finding index of nearest point in numpy arrays of x and y coordinates
  17. Is there an expression for an infinite iterator?
  18. How to check if an object is a generator object in python?
  19. How to join two generators in Python?
  20. Unbounded range()
  21. Non biased return a list of n random positive numbers (>=0) so that their sum == total_sum
  22. “For” loop first iteration
  23. Binary search algorithm in python
  24. Sliding window maximum in O(n) time
  25. How to join two generators (or other iterables) in Python?
  26. NumPy grouping using itertools.groupby performance
  27. A set union find algorithm
  28. Finding the most frequent character in a string
  29. Do python’s variable length arguments (*args) expand a generator at function call time?
  30. Coroutine vs Continuation vs Generator

Leave a Comment