Are locks unnecessary in multi-threaded Python code because of the GIL?

by

You will still need locks if you share state between threads. The GIL only protects the interpreter internally. You can still have inconsistent updates in your own code.

For example:

#!/usr/bin/env python
import threading

shared_balance = 0

class Deposit(threading.Thread):
    def run(self):
        for _ in xrange(1000000):
            global shared_balance
            balance = shared_balance
            balance += 100
            shared_balance = balance

class Withdraw(threading.Thread):
    def run(self):
        for _ in xrange(1000000):
            global shared_balance
            balance = shared_balance
            balance -= 100
            shared_balance = balance

threads = [Deposit(), Withdraw()]

for thread in threads:
    thread.start()

for thread in threads:
    thread.join()

print shared_balance

Here, your code can be interrupted between reading the shared state (balance = shared_balance) and writing the changed result back (shared_balance = balance), causing a lost update. The result is a random value for the shared state.

To make the updates consistent, run methods would need to lock the shared state around the read-modify-write sections (inside the loops) or have some way to detect when the shared state had changed since it was read.

More Related Contents:

  1. Why the Global Interpreter Lock?
  2. How to run functions in parallel?
  3. threading.Timer – repeat function every ‘n’ seconds
  4. Freezing/Hanging tkinter GUI in waiting for the thread to complete
  5. Make sure only a single instance of a program is running
  6. Threading in a PyQt application: Use Qt threads or Python threads?
  7. Does Python support multithreading? Can it speed up execution time?
  8. What is the use of join() in Python threading?
  9. Is there any way to kill a Thread?
  10. How to start and stop a thread
  11. A very simple multithreading parallel URL fetching (without queue)
  12. background function in Python
  13. threading ignores KeyboardInterrupt exception
  14. Python: Something like `map` that works on threads [closed]
  15. Multi-threaded use of SQLAlchemy
  16. Python time.sleep() vs event.wait()
  17. How to exit the entire application from a Python thread?
  18. Python – appending to same file from multiple threads
  19. deciding among subprocess, multiprocessing, and thread in Python?
  20. How to get a faster speed when using multi-threading in python
  21. How to run multiple functions at the same time?
  22. What is the use of join() in threading?
  23. Python: How to NOT wait for a thread to finish to carry on? [duplicate]
  24. Threads vs. Async
  25. multiprocess or threading in python?
  26. How do I pass an async function to a thread target in Python?
  27. Understanding Multiprocessing: Shared Memory Management, Locks and Queues in Python
  28. FastAPI python: How to run a thread in the background?
  29. How to prefetch data using a custom python function in tensorflow
  30. How do I run a long-running job in the background in Python

Leave a Comment