Can you make a python subprocess output stdout and stderr as usual, but also capture the output as a string? [duplicate]

by

This example seems to work for me:

# -*- Mode: Python -*-
# vi:si:et:sw=4:sts=4:ts=4

import subprocess
import sys
import select

p = subprocess.Popen(["find", "/proc"],
    stdout=subprocess.PIPE, stderr=subprocess.PIPE)

stdout = []
stderr = []

while True:
    reads = [p.stdout.fileno(), p.stderr.fileno()]
    ret = select.select(reads, [], [])

    for fd in ret[0]:
        if fd == p.stdout.fileno():
            read = p.stdout.readline()
            sys.stdout.write('stdout: ' + read)
            stdout.append(read)
        if fd == p.stderr.fileno():
            read = p.stderr.readline()
            sys.stderr.write('stderr: ' + read)
            stderr.append(read)

    if p.poll() != None:
        break

print 'program ended'

print 'stdout:', "".join(stdout)
print 'stderr:', "".join(stderr)

In general, any situation where you want to do stuff with multiple file descriptors at the same time and you don’t know which one will have stuff for you to read, you should use select or something equivalent (like a Twisted reactor).

More Related Contents:

  1. Using module ‘subprocess’ with timeout
  2. read subprocess stdout line by line
  3. Python: execute cat subprocess in parallel
  4. Python threading multiple bash subprocesses?
  5. Calling a python script with input within a python script using subprocess
  6. Difference between subprocess.Popen and os.system
  7. Subprocess.Popen: cloning stdout and stderr both to terminal and variables
  8. Python popen command. Wait until the command is finished
  9. How can I specify working directory for popen
  10. Multiple pipes in subprocess
  11. File not found error when launching a subprocess containing piped commands
  12. subprocess readline hangs waiting for EOF
  13. Run child processes as different user from a long running Python process
  14. Run Process and Don’t Wait
  15. Using a Python subprocess call to invoke a Python script
  16. Python Subprocess.Popen from a thread
  17. How to run a background process and do *not* wait?
  18. How to parallelize file downloads?
  19. Communicate multiple times with a process without breaking the pipe?
  20. Python – how to execute shell commands with pipe, but without ‘shell=True’?
  21. What can lead to “IOError: [Errno 9] Bad file descriptor” during os.system()?
  22. Launch a python script from another script, with parameters in subprocess argument
  23. Python: subprocess call with shell=False not working
  24. Python subprocess.Popen as different user on Windows
  25. Bash style process substitution with Python’s Popen
  26. Execute Subprocess in Background
  27. How to read the first byte of a subprocess’s stdout and then discard the rest in Python?
  28. Cannot find the file specified when using subprocess.call(‘dir’, shell=True) in Python
  29. subprocess.Popen in different console
  30. printing stdout in realtime from a subprocess that requires stdin

Leave a Comment