Deadlock with logging multiprocess/multithread python script

by

This is probably bug 6721.

The problem is common in any situation where you have locks, threads and forks. If thread 1 had a lock while thread 2 calls fork, in the forked process, there will only be thread 2 and the lock will be held forever. In your case, that is logging.StreamHandler.lock.

A fix can be found here (permalink) for the logging module. Note that you need to take care of any other locks, too.

More Related Contents:

  1. multiprocess or threading in python?
  2. How to use asyncio with threading in Python is Method threading.Timer
  3. String formatting: % vs. .format vs. f-string literal
  4. Multiprocessing vs Threading Python [duplicate]
  5. Are lists thread-safe?
  6. thread starts running before calling Thread.start
  7. How to use multiprocessing queue in Python?
  8. How to make built-in containers (sets, dicts, lists) thread safe?
  9. TypeError: only length-1 arrays can be converted to Python scalars while trying to exponentially fit data
  10. Using win32com with multithreading
  11. Threads and tkinter
  12. Program freezing during the execution of a function in Tkinter
  13. How to run multiple jobs in one Sparkcontext from separate threads in PySpark?
  14. Kill a running subprocess call
  15. Logging to two files with different settings
  16. Python threading. How do I lock a thread?
  17. How to easily print ascii-art text? [closed]
  18. Logging within pytest tests
  19. Python Threading inside a class
  20. Meaning of daemon property on Python Threads
  21. real time subprocess.Popen via stdout and PIPE
  22. How to get the return value from a thread?
  23. Log exception with traceback in Python
  24. Threaded Tkinter script crashes when creating the second Toplevel widget
  25. How to start threads at the same time in Python [duplicate]
  26. How do I log from my Python Spark script
  27. Is a variable swap guaranteed to be atomic in python?
  28. Restarting a thread in Python
  29. How to prefetch data using a custom python function in tensorflow
  30. How do I run a long-running job in the background in Python

Leave a Comment