How to read file N lines at a time?

by

One solution would be a list comprehension and the slice operator:

with open(filename, 'r') as infile:
    lines = [line for line in infile][:N]

After this lines is tuple of lines. However, this would load the complete file into memory. If you don’t want this (i.e. if the file could be really large) there is another solution using a generator expression and islice from the itertools package:

from itertools import islice
with open(filename, 'r') as infile:
    lines_gen = islice(infile, N)

lines_gen is a generator object, that gives you each line of the file and can be used in a loop like this:

for line in lines_gen:
    print line

Both solutions give you up to N lines (or fewer, if the file doesn’t have that much).

More Related Contents:

  1. Create or open file in python [closed]
  2. Find all files in a directory with extension .txt in Python
  3. How to build a basic iterator?
  4. Iterate over all pairs of consecutive items in a list [duplicate]
  5. How to open a file for both reading and writing?
  6. Circular list iterator in Python
  7. Print string to text file
  8. Python recursive folder read
  9. How might I remove duplicate lines from a file?
  10. What’s the shortest way to count the number of items in a generator/iterator?
  11. Writing a list to a file with Python, with newlines
  12. File read using “open()” vs “with open()” [duplicate]
  13. How do I create an incrementing filename in Python?
  14. What does “three dots” in Python mean when indexing what looks like a number?
  15. How to convert an iterable to a stream?
  16. Making a python iterator go backwards?
  17. Python write to a file returns empty file
  18. split a generator/iterable every n items in python (splitEvery)
  19. Iterate over the lines of a string
  20. How to safely open/close files in python 2.4
  21. Performance Advantages to Iterators?
  22. Reading a file with a specified delimiter for newline
  23. How to read a single character at a time from a file in Python?
  24. Undo a file readline() operation so file-pointer is back in original state
  25. Write file with specific permissions in Python
  26. Is it possible to get writing access to raw devices using python with windows?
  27. pickle.load() raising EOFError in Windows
  28. “OSError: [Errno 17] File exists” when trying to use os.makedirs [duplicate]
  29. What does it mean to “consume” in Python? In an iterator?
  30. hasnext() for Python iterators?

Leave a Comment