How to read a file in reverse order?

by

A correct, efficient answer written as a generator.

import os

def reverse_readline(filename, buf_size=8192):
    """A generator that returns the lines of a file in reverse order"""
    with open(filename) as fh:
        segment = None
        offset = 0
        fh.seek(0, os.SEEK_END)
        file_size = remaining_size = fh.tell()
        while remaining_size > 0:
            offset = min(file_size, offset + buf_size)
            fh.seek(file_size - offset)
            buffer = fh.read(min(remaining_size, buf_size))
            remaining_size -= buf_size
            lines = buffer.split('\n')
            # The first line of the buffer is probably not a complete line so
            # we'll save it and append it to the last line of the next buffer
            # we read
            if segment is not None:
                # If the previous chunk starts right from the beginning of line
                # do not concat the segment to the last line of new chunk.
                # Instead, yield the segment first 
                if buffer[-1] != '\n':
                    lines[-1] += segment
                else:
                    yield segment
            segment = lines[0]
            for index in range(len(lines) - 1, 0, -1):
                if lines[index]:
                    yield lines[index]
        # Don't yield None if the file was empty
        if segment is not None:
            yield segment

More Related Contents:

  1. How to read a file line-by-line into a list?
  2. How to move a file in Python?
  3. How often does python flush to a file?
  4. Call a function from another file?
  5. Iterating on a file doesn’t work the second time
  6. Directory-tree listing in Python
  7. How to write to a CSV line by line?
  8. FileNotFoundError: [Errno 2] No such file or directory [duplicate]
  9. How to delete the contents of a folder?
  10. Open file in a relative location in Python
  11. check what files are open in Python
  12. Right way to reverse a pandas DataFrame?
  13. How to convert a file to utf-8 in Python?
  14. Read from a log file as it’s being written using python
  15. Is close() necessary when using iterator on a Python file object [duplicate]
  16. Finding duplicate files and removing them
  17. Compare two files report difference in python
  18. Python 2.7: Print to File
  19. Reading files in a particular order in python
  20. Python Random Access File
  21. Best method for reading newline delimited files and discarding the newlines?
  22. How to safely write to a file?
  23. Create a temporary FIFO (named pipe) in Python?
  24. Read from File, or STDIN
  25. Detect duplicate MP3 files with different bitrates and/or different ID3 tags?
  26. UnicodeDecodeError in Python when reading a file, how to ignore the error and jump to the next line?
  27. Sort a list of tuples by second value, reverse=True and then by key, reverse=False
  28. Pydub (WindowsError: [Error 2] The system can not find the file specified)
  29. Creating files and directories via Python
  30. Best way to choose a random file from a directory

Leave a Comment