Python how to read N number of lines at a time

by

islice() can be used to get the next n items of an iterator. Thus, list(islice(f, n)) will return a list of the next n lines of the file f. Using this inside a loop will give you the file in chunks of n lines. At the end of the file, the list might be shorter, and finally the call will return an empty list.

from itertools import islice
with open(...) as f:
    while True:
        next_n_lines = list(islice(f, n))
        if not next_n_lines:
            break
        # process next_n_lines

An alternative is to use the grouper pattern:

with open(...) as f:
    for next_n_lines in izip_longest(*[f] * n):
        # process next_n_lines

More Related Contents:

  1. How do I use itertools.groupby()?
  2. permutations with unique values
  3. Permutations between two lists of unequal length
  4. Skip first couple of lines while reading lines in Python file
  5. How to apply itertools.product to elements of a list of lists? [duplicate]
  6. itertools product speed up
  7. Powersets in Python using itertools
  8. N-D version of itertools.combinations in numpy
  9. importing izip from itertools module gives NameError in Python 3.x
  10. Splitting large text file into smaller text files by line numbers using Python
  11. What is the purpose of Python’s itertools.repeat?
  12. How to turn an itertools “grouper” object into a list
  13. Replace list of list with “condensed” list of list while maintaining order
  14. How can I pivot a dataframe?
  15. Convert python datetime to epoch with strftime
  16. How to generate keyboard events?
  17. Using python Requests with javascript pages
  18. List comprehension vs. lambda + filter
  19. Inserting Line at Specified Position of a Text File
  20. Does Python’s time.time() return the local or UTC timestamp?
  21. confidence and prediction intervals with StatsModels
  22. How to use cmp() in Python 3?
  23. How to disable the minor ticks of log-plot in Matplotlib?
  24. return eats exception
  25. How to use regular expression in lxml xpath?
  26. In Python, how do you find the index of the first value greater than a threshold in a sorted list?
  27. Fatal Python error: init_fs_encoding: failed to get the Python codec of the filesystem encoding, when trying to start uwsgi
  28. How can I obtain the image size using a standard Python class (without using an external library)?
  29. Autocomplete in PyCharm for Python compiled extensions
  30. How to warp an image using deformed mesh

Leave a Comment