Python subprocess get children’s output to file and terminal?

by

The call() function is just Popen(*args, **kwargs).wait(). You could call Popen directly and use stdout=PIPE argument to read from p.stdout:

#!/usr/bin/env python
import sys
from subprocess import Popen, PIPE
from threading import Thread


def tee(infile, *files):
    """Print `infile` to `files` in a separate thread."""

    def fanout(infile, *files):
        with infile:
            for line in iter(infile.readline, b""):
                for f in files:
                    f.write(line)

    t = Thread(target=fanout, args=(infile,) + files)
    t.daemon = True
    t.start()
    return t


def teed_call(cmd_args, **kwargs):
    stdout, stderr = [kwargs.pop(s, None) for s in ["stdout", "stderr"]]
    p = Popen(
        cmd_args,
        stdout=PIPE if stdout is not None else None,
        stderr=PIPE if stderr is not None else None,
        **kwargs
    )
    threads = []
    if stdout is not None:
        threads.append(
            tee(p.stdout, stdout, getattr(sys.stdout, "buffer", sys.stdout))
        )
    if stderr is not None:
        threads.append(
            tee(p.stderr, stderr, getattr(sys.stderr, "buffer", sys.stderr))
        )
    for t in threads:
        t.join()  # wait for IO completion
    return p.wait()


outf, errf = open("out.txt", "wb"), open("err.txt", "wb")
assert not teed_call(["cat", __file__], stdout=None, stderr=errf)
assert not teed_call(["echo", "abc"], stdout=outf, stderr=errf, bufsize=0)
assert teed_call(["gcc", "a b"], close_fds=True, stdout=outf, stderr=errf)

More Related Contents:

  1. Actual meaning of ‘shell=True’ in subprocess
  2. How to terminate a python subprocess launched with shell=True
  3. Python subprocess readlines() hangs
  4. How to redirect output with subprocess in Python?
  5. Using sudo with Python script
  6. Run a program from python, and have it continue to run after the script is killed
  7. subprocess.call using string vs using list
  8. Popen waiting for child process even when the immediate child has terminated
  9. Understanding Popen.communicate
  10. Execute terminal command from python in new terminal window?
  11. File not found error when launching a subprocess containing piped commands
  12. Python: how to kill child process(es) when parent dies?
  13. OSError: [WinError 193] %1 is not a valid Win32 application
  14. subprocess.Popen() error (No such file or directory) when calling command with arguments as a string
  15. Using subprocess to run Python script on Windows
  16. running multiple bash commands with subprocess
  17. Keep a subprocess alive and keep giving it commands? Python
  18. Python output to Console within Subprocess from the child scricpt
  19. python getoutput() equivalent in subprocess [duplicate]
  20. Why subprocess.Popen doesn’t work when args is sequence?
  21. How to run multiple commands synchronously from one subprocess.Popen command?
  22. Redirect subprocess stderr to stdout
  23. Interacting with bash from python
  24. Event Driven System Call in Python
  25. How do I eliminate Windows consoles from spawned processes in Python (2.7)? [duplicate]
  26. Trying to fix tkinter GUI freeze-ups (using threads)
  27. Python Subprocess: Too Many Open Files
  28. How can I spawn new shells to run Python scripts from a base Python script?
  29. Handling directories with spaces Python subprocess.call()
  30. Opening a process with Popen and getting the PID

Leave a Comment