Last unbuffered line can’t be read

by

If stdout of apt-get is redirected to a pipe e.g.,

$ apt-get download firefox | cat

then it doesn’t report progress (the last line e.g., 2% [1 firefox 646 kB/34.9 MB 2%] will not be in the output). stdout=subprocess.PIPE naturally creates a pipe; therefore apt-get doesn’t print the download progress in your case.

If you want both to capture apt-get output and to see it on the screen in real-time with the last line (progress report) present then you could use pexpect module to trick the child process into thinking that it runs in a terminal:

import sys
import pexpect # $ pip install pexpect

output, exitstatus = pexpect.runu('apt-get download firefox',
                                  logfile=sys.stdout,
                                  withexitstatus=1)

You could do the same using only stdlib pty module:

#!/usr/bin/env python3
import os
import pty

output = []
def read(fd):
    data = os.read(fd, 1024)
    output.append(data)
    return data
status = pty.spawn(['apt-get', 'download', 'firefox'], read)

@eryksun on Python Issue tracker suggested apt-get‘s --quiet option:

#!/usr/bin/env python3
import shlex
from io import TextIOWrapper
from subprocess import Popen, PIPE

output = []
with Popen(shlex.split("apt-get --quiet=0 download firefox"),
           stdout=PIPE, bufsize=1) as p:
    # recognize '\r' as newline but don't convert it to '\n'
    for line in TextIOWrapper(p.stdout, newline=""):
        print(line, end='', flush=True) # print to terminal
        output.append(line) # save for later
print(p.returncode)

More Related Contents:

  1. using Subprocess to avoid long-running task from disconnecting discord.py bot?
  2. Could someone please go through this code line by line and explain it in Pseudocode or English
  3. How to change the location of the column name in pandas?
  4. How to retrieve the text of a WebElement using Selenium – Python
  5. What does sys.intern() do and when should it be used?
  6. DeprecationWarning: executable_path has been deprecated, please pass in a Service object
  7. SessionNotCreatedException: Message: session not created from disconnected: unable to connect to renderer with ChromeDriver 2.45 Chrome v71
  8. How can I quickly change pixels in a image from a color dictionary?
  9. Python output to Console within Subprocess from the child scricpt
  10. TypeError: POST data should be bytes or an iterable of bytes. It cannot be str
  11. ImportError: cannot import name ‘joblib’ from ‘sklearn.externals’
  12. Add numpy.get_include() argument to setuptools without preinstalled numpy
  13. Getting error when using pynput with pyinstaller
  14. Tensorflow (.pb) format to Keras (.h5)
  15. How to combine gridspec with plt.subplots() to eliminate space between rows of subplots
  16. Import a module from both within same package and from outside the package in Python 3
  17. How to check if input is float or int?
  18. SKLearn warning “valid feature names” in version 1.0
  19. pip3 install not working – No module named ‘pip._vendor.pkg_resources’
  20. AttributeError: ‘WebDriver’ object has no attribute ‘find_element_by_xpath’
  21. How to use Boto3 pagination
  22. Trying to fix tkinter GUI freeze-ups (using threads)
  23. How do I integrate custom exception handling with the FastAPI exception handling?
  24. How does one insert statistical annotations (stars or p-values) into matplotlib / seaborn plots?
  25. How do I print colored output with Python 3?
  26. How to retrieve the whole message body using Gmail API (python)
  27. selenium.common.exceptions.WebDriverException: Message: unknown error: unable to discover open pages using ChromeDriver through Selenium
  28. Browser Cookie never expires
  29. Debugging Numpy VisibleDeprecationWarning (ndarray from ragged nested sequences)
  30. How to determine what version of python3 tkinter is installed on my linux machine?

Leave a Comment