System-wide mutex in Python on Linux

by

The “traditional” Unix answer is to use file locks. You can use lockf(3) to lock sections of a file so that other processes can’t edit it; a very common abuse is to use this as a mutex between processes. The python equivalent is fcntl.lockf.

Traditionally you write the PID of the locking process into the lock file, so that deadlocks due to processes dying while holding the lock are identifiable and fixable.

This gets you what you want, since your lock is in a global namespace (the filesystem) and accessible to all processes. This approach also has the perk that non-Python programs can participate in your locking. The downside is that you need a place for this lock file to live; also, some filesystems don’t actually lock correctly, so there’s a risk that it will silently fail to achieve exclusion. You win some, you lose some.

More Related Contents:

  1. How to terminate a python subprocess launched with shell=True
  2. Execute Python script via crontab
  3. Is it possible to change the Environment of a parent process in Python?
  4. Getting MAC Address
  5. Python pysftp get_r from Linux works fine on Linux but not on Windows
  6. fcntl substitute on Windows
  7. How to get PID by process name?
  8. Python FTP get the most recent file by date
  9. Python: how to kill child process(es) when parent dies?
  10. Access Denied page with headless Chrome on Linux while headed Chrome works on windows using Selenium through Python
  11. Find size and free space of the filesystem containing a given file
  12. Call Python script from bash with argument
  13. How to make Python script run as service?
  14. How to update-alternatives to Python 3 without breaking apt?
  15. Calling a python script from command line without typing “python” first
  16. Trouble installing scipy in virtualenv on a amazon ec2 linux micro instance
  17. How to split a huge csv file based on content of first column?
  18. OSError 38 [Errno 38] with multiprocessing
  19. gunicorn command not found, but it’s in my requirements.txt
  20. Fetching the output of a command executed through os.system() command [duplicate]
  21. Tkinter.PhotoImage doesn’t not support png image
  22. How can I send a signal from a python program?
  23. How to make python window run as “Always On Top”?
  24. Get local network interface addresses using only proc?
  25. Environment Variables when script run by cron
  26. Multiprocessing: use only the physical cores?
  27. kill process with python
  28. Move and zoom a tkinter canvas with mouse
  29. Python multiprocessing linux windows difference
  30. Dropping Root Permissions In Python

Leave a Comment