Check if a file is not open nor being used by another process

by

An issue with trying to find out if a file is being used by another process is the possibility of a race condition. You could check a file, decide that it is not in use, then just before you open it another process (or thread) leaps in and grabs it (or even deletes it).

Ok, let’s say you decide to live with that possibility and hope it does not occur. To check files in use by other processes is operating system dependant.

On Linux it is fairly easy, just iterate through the PIDs in /proc. Here is a generator that iterates over files in use for a specific PID:

def iterate_fds(pid):
    dir="/proc/"+str(pid)+'/fd'
    if not os.access(dir,os.R_OK|os.X_OK): return

    for fds in os.listdir(dir):
        for fd in fds:
            full_name = os.path.join(dir, fd)
            try:
                file = os.readlink(full_name)
                if file == '/dev/null' or \
                  re.match(r'pipe:\[\d+\]',file) or \
                  re.match(r'socket:\[\d+\]',file):
                    file = None
            except OSError as err:
                if err.errno == 2:     
                    file = None
                else:
                    raise(err)

            yield (fd,file)

On Windows it is not quite so straightforward, the APIs are not published. There is a sysinternals tool (handle.exe) that can be used, but I recommend the PyPi module psutil, which is portable (i.e., it runs on Linux as well, and probably on other OS):

import psutil

for proc in psutil.process_iter():
    try:
        # this returns the list of opened files by the current process
        flist = proc.open_files()
        if flist:
            print(proc.pid,proc.name)
            for nt in flist:
                print("\t",nt.path)

    # This catches a race condition where a process ends
    # before we can examine its files    
    except psutil.NoSuchProcess as err:
        print("****",err)

More Related Contents:

  1. how to can i go over a file twice?
  2. How often does python flush to a file?
  3. Call a function from another file?
  4. How to read a file in reverse order?
  5. open() gives FileNotFoundError/IOError: Errno 2 No such file or directory
  6. How to check whether a file is empty or not
  7. How do I get the path and name of the file that is currently executing?
  8. Open file in a relative location in Python
  9. How can I separate the functions of a class into multiple files?
  10. How to find out whether a file is at its `eof`?
  11. How come a file doesn’t get written until I stop the program?
  12. Reading two text files line by line simultaneously
  13. filename and line number of Python script
  14. Search for a file using a wildcard
  15. Python append multiple files in given order to one big file
  16. Save a large file using the Python requests library [duplicate]
  17. How to add a key-value to JSON data retrieved from a file?
  18. How does python close files that have been gc’ed?
  19. Why do I get “Pickle – EOFError: Ran out of input” reading an empty file?
  20. How do I wrap a string in a file in Python?
  21. “TypeError: a bytes-like object is required, not ‘str'” when handling file content in Python 3
  22. Create a temporary FIFO (named pipe) in Python?
  23. Pydub (WindowsError: [Error 2] The system can not find the file specified)
  24. For loop not working twice on the same file descriptor [duplicate]
  25. f.read coming up empty
  26. Determining Whether a Directory is Writeable
  27. Find all CSV files in a directory using Python
  28. How do I create a file in python without overwriting an existing file
  29. Python not able to open file with non-english characters in path
  30. Writing to a new file if it doesn’t exist, and appending to a file if it does

Leave a Comment