Run subprocess and print output to logging

by

You could try to pass the pipe directly without buffering the whole subprocess output in memory:

from subprocess import Popen, PIPE, STDOUT

process = Popen(command_line_args, stdout=PIPE, stderr=STDOUT)
with process.stdout:
    log_subprocess_output(process.stdout)
exitcode = process.wait() # 0 means success

where log_subprocess_output() could look like:

def log_subprocess_output(pipe):
    for line in iter(pipe.readline, b''): # b'\n'-separated lines
        logging.info('got line from subprocess: %r', line)

More Related Contents:

  1. live output from subprocess command
  2. Where is a complete example of logging.config.dictConfig?
  3. How to add a custom loglevel to Python’s logging facility
  4. real time subprocess.Popen via stdout and PIPE
  5. python exception message capturing
  6. Can Python’s logging format be modified depending on the message log level?
  7. How to configure logging to syslog in Python?
  8. Lazy logger message string evaluation
  9. How do I log from my Python Spark script
  10. How to write custom python logging handler?
  11. python logging to database
  12. Suppress newline in Python logging module
  13. Naming Python loggers
  14. Python logging: use milliseconds in time format
  15. Django Setup Default Logging
  16. How to use logging.getLogger(__name__) in multiple modules
  17. Does python logging flush every log?
  18. No handlers could be found for logger
  19. How to use Python’s RotatingFileHandler
  20. redirect prints to log file
  21. Set logging levels
  22. How to change filehandle with Python logging on the fly with different classes and imports
  23. Can structured logging be done with Pythons standard library?
  24. Python Logging – Disable logging from imported modules
  25. Redirect Python ‘print’ output to Logger
  26. How to log source file name and line number in Python
  27. Executing a subprocess fails
  28. python subprocess Popen environment PATH?
  29. How to add background tasks when request fails and HTTPException is raised in FastAPI?
  30. Launch IPython notebook with selected browser

Leave a Comment