Are Python built-in containers thread-safe?

by

You need to implement your own locking for all shared variables that will be modified in Python. You don’t have to worry about reading from the variables that won’t be modified (ie, concurrent reads are ok), so immutable types (frozenset, tuple, str) are probably safe, but it wouldn’t hurt. For things you’re going to be changing – list, set, dict, and most other objects, you should have your own locking mechanism (while in-place operations are ok on most of these, threads can lead to super-nasty bugs – you might as well implement locking, it’s pretty easy).

By the way, I don’t know if you know this, but locking is very easy in Python – create a threading.lock object, and then you can acquire/release it like this:

import threading
list1Lock = threading.Lock()

with list1Lock:
    # change or read from the list here
# continue doing other stuff (the lock is released when you leave the with block)

In Python 2.5, do from __future__ import with_statement; Python 2.4 and before don’t have this, so you’ll want to put the acquire()/release() calls in try:...finally: blocks:

import threading
list1Lock = threading.Lock()

try:
    list1Lock.acquire()
    # change or read from the list here
finally:
    list1Lock.release()
# continue doing other stuff (the lock is released when you leave the with block)

Some very good information about thread synchronization in Python.

More Related Contents:

  1. Are global variables thread-safe in Flask? How do I share data between requests?
  2. Redirecting stdout and stderr to a PyQt4 QTextEdit from a secondary thread
  3. Thread Safety in Python’s dictionary
  4. How to make built-in containers (sets, dicts, lists) thread safe?
  5. Is the += operator thread-safe in Python?
  6. Is the Session object from Python’s Requests library thread safe?
  7. Simplest way for PyQT Threading
  8. Are urllib2 and httplib thread safe?
  9. Queue.Queue vs. collections.deque
  10. Are Generators Threadsafe?
  11. How to share a variable between 2 threads
  12. Python 2.7: Print thread safe
  13. python dictionary is thread safe?
  14. How to leave/exit/deactivate a Python virtualenv
  15. Correct way to try/except using Python requests module?
  16. Get all the diagonals in a matrix/list of lists in Python
  17. Splitting a list based on a delimiter word
  18. Intersecting two dictionaries
  19. Python convert tuple to string
  20. Is the shortcircuit behaviour of Python’s any/all explicit?
  21. Iterating through two lists in Django templates
  22. Pythonic way to combine for-loop and if-statement
  23. Iterating over a numpy array
  24. An integer is required? open()
  25. What is the difference between pandas agg and apply function?
  26. Efficient outer product in python
  27. Python wildcard search in string
  28. Python: Remove Duplicate Items from Nested list
  29. Is there a way to make the Tkinter text widget read only?
  30. Finding the full width half maximum of a peak

Leave a Comment