Subprocess timeout failure

by

check_output() with timeout is essentially:

with Popen(*popenargs, stdout=PIPE, **kwargs) as process:
    try:
        output, unused_err = process.communicate(inputdata, timeout=timeout)
    except TimeoutExpired:
        process.kill()
        output, unused_err = process.communicate()
        raise TimeoutExpired(process.args, timeout, output=output)

There are two issues:

It leads to the behaviour that you observed: the TimeoutExpired happens in a second, the shell is killed, but check_output() returns only in 30 seconds after the grandchild sleep process exits.

To workaround the issues, kill the whole process tree (all subprocesses that belong to the same group):

#!/usr/bin/env python3
import os
import signal
from subprocess import Popen, PIPE, TimeoutExpired
from time import monotonic as timer

start = timer()
with Popen('sleep 30', shell=True, stdout=PIPE, preexec_fn=os.setsid) as process:
    try:
        output = process.communicate(timeout=1)[0]
    except TimeoutExpired:
        os.killpg(process.pid, signal.SIGINT) # send signal to the process group
        output = process.communicate()[0]
print('Elapsed seconds: {:.2f}'.format(timer() - start))

Output

Elapsed seconds: 1.00

More Related Contents:

  1. Running shell command and capturing the output
  2. A non-blocking read on a subprocess.PIPE in Python
  3. How to hide output of subprocess
  4. Retrieving the output of subprocess.call() [duplicate]
  5. Constantly print Subprocess output while process is running
  6. subprocess wildcard usage
  7. Non blocking subprocess.call
  8. Interactive input/output using Python
  9. Run command and get its stdout, stderr separately in near real time like in a terminal
  10. How do I get ‘real-time’ information back from a subprocess.Popen in python (2.5)
  11. Use subprocess to send a password
  12. Running an interactive command from within Python
  13. Launch a shell command with in a python script, wait for the termination and return to the script
  14. When to use Shell=True for Python subprocess module [duplicate]
  15. ‘^’ is ignored by Python – how to escape ‘^’ character in Popen Windows?
  16. Break the function after certain time
  17. What’s the difference between subprocess Popen and call (how can I use them)?
  18. Python subprocess in parallel
  19. Passing variables to a subprocess call [duplicate]
  20. How to get the output from os.system()? [duplicate]
  21. In Python 2.5, how do I kill a subprocess?
  22. Why does subprocess.Popen() with shell=True work differently on Linux vs Windows?
  23. Launch IPython notebook with selected browser
  24. Sending ^C to Python subprocess objects on Windows
  25. Execute Commands Sequentially in Python?
  26. Killing child process when parent crashes in python
  27. How to install and import Python modules at runtime
  28. Using greater than operator with subprocess.call
  29. How to terminate long-running computation (CPU bound task) in Python using asyncio and concurrent.futures.ProcessPoolExecutor?
  30. Advantages of subprocess over os.system

Leave a Comment