Appending to the same list from different processes using multiprocessing

by

Global variables are not shared between processes.

You need to use multiprocessing.Manager.list:

from multiprocessing import Process, Manager

def dothing(L, i):  # the managed list `L` passed explicitly.
    L.append("anything")

if __name__ == "__main__":
    with Manager() as manager:
        L = manager.list()  # <-- can be shared between processes.
        processes = []
        for i in range(5):
            p = Process(target=dothing, args=(L,i))  # Passing the list
            p.start()
            processes.append(p)
        for p in processes:
            p.join()
        print L

See Sharing state between processes¶ (Server process part).

More Related Contents:

  1. Share a list between different processes?
  2. How to make a dict from n’th indices of tuples in list
  3. How do I concatenate items in a list to a single string?
  4. Why does this iterative list-growing code give IndexError: list assignment index out of range?
  5. How to run functions in parallel?
  6. Slicing a list in Python without generating a copy
  7. Python list doesn’t reflect variable change
  8. Why is [] faster than list()?
  9. How can I multiply all items in a list together with Python?
  10. Remove trailing newline from the elements of a string list
  11. How to loop through all but the last item of a list?
  12. Take the content of a list and append it to another list
  13. Extract elements of list at odd positions
  14. pandas multiprocessing apply
  15. How to find the maximum value in a list of tuples? [duplicate]
  16. How does the max() function work on list of strings in python?
  17. Python: How to remove empty lists from a list? [duplicate]
  18. Exception thrown in multiprocessing Pool not detected
  19. How to get the n next values of a generator in a list (python)
  20. Python Multiprocessing Lib Error (AttributeError: __exit__)
  21. How do I sort this list in Python, if my date is in a String?
  22. Convert all strings in a list to integers
  23. Show the progress of a Python multiprocessing pool imap_unordered call?
  24. Python Sort One List According to Another List
  25. python – get list of tuples first index?
  26. Can I get a return value from multiprocessing.Process?
  27. Python: Elegant and efficient ways to mask a list
  28. Creating a list in Python- something sneaky going on?
  29. Rearranging list based on order of another list
  30. list comprehension with multiple conditions (python)

Leave a Comment