Reading from a frequently updated file

by

I would recommend looking at David Beazley’s Generator Tricks for Python, especially Part 5: Processing Infinite Data. It will handle the Python equivalent of a tail -f logfile command in real-time.

# follow.py
#
# Follow a file like tail -f.

import time
def follow(thefile):
    thefile.seek(0,2)
    while True:
        line = thefile.readline()
        if not line:
            time.sleep(0.1)
            continue
        yield line

if __name__ == '__main__':
    logfile = open("run/foo/access-log","r")
    loglines = follow(logfile)
    for line in loglines:
        print line,

More Related Contents:

  1. Lazy Method for Reading Big File in Python?
  2. Understanding generators in Python
  3. Reading binary file and looping over each byte
  4. Difference between Python’s Generators and Iterators
  5. open() gives FileNotFoundError/IOError: Errno 2 No such file or directory
  6. How do I know if a generator is empty from the start?
  7. Python 32-bit memory limits on 64bit windows
  8. Can iterators be reset in Python?
  9. Python read JSON file and modify
  10. Converting “yield from” statement to Python 2.7 code
  11. How to write a generator class?
  12. Create file but if name exists add number
  13. Length of generator output [duplicate]
  14. How to open a password protected excel file using python?
  15. pandas to_csv output quoting issue
  16. How to get the n next values of a generator in a list (python)
  17. python close file descriptor question
  18. Best way to receive the ‘return’ value from a python generator
  19. ValueError : I/O operation on closed file
  20. What does the “yield” keyword do in Python?
  21. Behaviour of truncate() method in Python
  22. How to read lines from a file in python starting from the end
  23. Why do list comprehensions write to the loop variable, but generators don’t? [duplicate]
  24. Convert percent string to float in pandas read_csv
  25. Saving response from Requests to file
  26. How to insert / retrieve a file stored as a BLOB in a MySQL db using python
  27. Do python’s variable length arguments (*args) expand a generator at function call time?
  28. Python – How to check if a file is used by another application?
  29. Coroutine vs Continuation vs Generator
  30. how to count the total number of lines in a text file using python

Leave a Comment