Is it safe to fork from within a thread?

by

The problem is that fork() only copies the calling thread, and any mutexes held in child threads will be forever locked in the forked child. The pthread solution was the pthread_atfork() handlers. The idea was you can register 3 handlers: one prefork, one parent handler, and one child handler. When fork() happens prefork is called prior to fork and is expected to obtain all application mutexes. Both parent and child must release all mutexes in parent and child processes respectively.

This isn’t the end of the story though! Libraries call pthread_atfork to register handlers for library specific mutexes, for example Libc does this. This is a good thing: the application can’t possibly know about the mutexes held by 3rd party libraries, so each library must call pthread_atfork to ensure it’s own mutexes are cleaned up in the event of a fork().

The problem is that the order that pthread_atfork handlers are called for unrelated libraries is undefined (it depends on the order that the libraries are loaded by the program). So this means that technically a deadlock can happen inside of a prefork handler because of a race condition.

For example, consider this sequence:

  1. Thread T1 calls fork()
  2. libc prefork handlers are called in T1 (e.g. T1 now holds all libc locks)
  3. Next, in Thread T2, a 3rd party library A acquires its own mutex AM, and then makes a libc call which requires a mutex. This blocks, because libc mutexes are held by T1.
  4. Thread T1 runs prefork handler for library A, which blocks waiting to obtain AM, which is held by T2.

There’s your deadlock and its unrelated to your own mutexes or code.

This actually happened on a project I once worked on. The advice I had found at that time was to choose fork or threads but not both. But for some applications that’s probably not practical.

More Related Contents:

  1. Are child processes created with fork() automatically killed when the parent is killed?
  2. How to make child process die after parent exits?
  3. Linux API to list running processes?
  4. How to increase thread priority in pthreads?
  5. fork() and output
  6. How to name a thread in Linux? [duplicate]
  7. How are user-level threads scheduled/created, and how are kernel level threads created?
  8. C++ Socket Server – Unable to saturate CPU
  9. How to check if a file has been opened by another application in C++?
  10. What is the difference between fork and thread?
  11. How to install the Raspberry Pi cross compiler on my Linux host machine?
  12. Mutex example / tutorial? [closed]
  13. How to check if a std::thread is still running?
  14. C++: what regex library should I use? [closed]
  15. What exactly is std::atomic?
  16. Mixing C++11 atomics and OpenMP
  17. C++ Equivalent to Java’s BlockingQueue
  18. Multithreaded Rendering on OpenGL
  19. How to make a multiple-read/single-write lock from more basic synchronization primitives?
  20. clock function in C++ with threads
  21. How to print pthread_t
  22. Netbeans 7.2 shows “Unable to resolve identifier” , although build is successful
  23. How to set breakpoints on future shared libraries with a command flag
  24. How to create a temporary directory in C++?
  25. /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version CXXABI_1.3.8′ not found
  26. Clearing terminal in Linux with C++ code
  27. std::map thread-safety
  28. C++11 std::mutex in Visual Studio 2012 deadlock when locked from DllMain()
  29. Forking vs Threading
  30. Why do I see 400x outlier timings when calling clock_gettime repeatedly?

Leave a Comment