How to prevent BrokenPipeError when doing a flush in Python?

by

The BrokenPipeError is normal as said phantom because the reading process (head) terminates and closes its end of the pipe while the writing process (python) still tries to write.

Is is an abnormal condition, and the python scripts receives a BrokenPipeError – more exactly, the Python interpreter receives a system SIGPIPE signal that it catches and raises the BrokenPipeError to allow the script to process the error.

And you effectively can process the error, because in your last example, you only see a message saying that the exception was ignored – ok it is not true, but seems related to this open issue in Python : Python developpers think important to warn user of the abnormal condition.

What really happens is that AFAIK the python interpreter always signals this on stderr, even if you catch the exception. But you just have to close stderr before exiting to get rid of the message.

I slightly changed your script to :

  • catch the error as you did in your last example
  • catch either IOError (that I get in Python34 on Windows64) or BrokenPipeError (in Python 33 on FreeBSD 9.0) – and display a message for that
  • display a custom Done message on stderr (stdout is closed due to the broken pipe)
  • close stderr before exiting to get rid of the message

Here is the script I used : 

import sys

try:
    for i in range(4000):
            print(i, flush=True)
except (BrokenPipeError, IOError):
    print ('BrokenPipeError caught', file = sys.stderr)

print ('Done', file=sys.stderr)
sys.stderr.close()

and here the result of python3.3 pipe.py | head -10 :

0
1
2
3
4
5
6
7
8
9
BrokenPipeError caught
Done

If you do not want the extraneous messages just use :

import sys

try:
    for i in range(4000):
            print(i, flush=True)
except (BrokenPipeError, IOError):
    pass

sys.stderr.close()

More Related Contents:

  1. How can I flush the output of the print function (unbuffer python output)?
  2. How can I flush the output of the print function?
  3. pyvenv-3.4 returned non-zero exit status 1
  4. How to limit number of CPU’s used by a python script w/o terminal or multiprocessing library?
  5. Accepting only letters as input [closed]
  6. How to blit a random image from a list Pygame [duplicate]
  7. How to remove English words from a file containing Dari words?
  8. How can I make a time delay? [duplicate]
  9. Calling a python script with input within a python script using subprocess
  10. Why is a list comprehension so much faster than appending to a list?
  11. certificate verify failed: unable to get local issuer certificate
  12. How do I resolve a TesseractNotFoundError?
  13. CSS not loading wrong MIME type Django [duplicate]
  14. What is “pkg-resources==0.0.0” in output of pip freeze command
  15. What is the fastest and most efficient way to append rows to a DataFrame?
  16. How to share numpy random state of a parent process with child processes?
  17. What is a “callable” in Python?
  18. How can I print multiple things (fixed text and/or variable values) on the same line, all at once?
  19. Why am I getting “invalid syntax” from an f-string? [duplicate]
  20. How can I use newline ‘\n’ in an f-string to format output?
  21. Check if rows in one dataframe exist in another dataframe
  22. Python: can’t assign to literal
  23. How to change the voice in pyttsx3?
  24. How to reuse an expression in a comprehension expression?
  25. How to move the background image with keys in pygame?
  26. Changing the directory where .pyc files are created
  27. match dates using python regular expressions
  28. Nested lambda statements when sorting lists
  29. How to get value of variable entered from user input?
  30. Handle JSON Decode Error when nothing returned

Leave a Comment