multiprocessing.Pool seems to work in Windows but not in ubuntu?

by

I don’t have a solution for your first problem. In fact, I can run your code repeatedly without fail on my 64-bit Ubuntu box with Enthought’s Python 2.7.1 [EPD 7.0-2 (64-bit)]. edit: It turns out the problem was being caused by your IDE (Wingware). The obvious workaround is to run the script from outside the IDE.

As to the second question, what happens is that on Unix every worker process inherits the same state of the random number generator from the parent process. This is why they generate identical pseudo-random sequences. All you have to do to fix this is call scipy.random.seed at the top of testfunc:

def testfunc(x0, N):
    sp.random.seed()
    print 'working with x0 = %s' % x0
    ...

More Related Contents:

  1. How to run functions in parallel?
  2. multiprocessing.Pool: When to use apply, apply_async or map?
  3. Dead simple example of using Multiprocessing Queue, Pool and Locking
  4. Share Large, Read-Only Numpy Array Between Multiprocessing Processes
  5. multiprocessing.Pool: What’s the difference between map_async and imap?
  6. Python Multiprocessing: Handling Child Errors in Parent
  7. Processing single file from multiple processes
  8. How to use a multiprocessing.Manager()?
  9. Solving embarassingly parallel problems using Python multiprocessing
  10. Log output of multiprocessing.Process
  11. pandas multiprocessing apply
  12. Why does Python’s multiprocessing module import __main__ when starting a new process on Windows?
  13. Appending to the same list from different processes using multiprocessing
  14. Exception thrown in multiprocessing Pool not detected
  15. Using the multiprocessing module for cluster computing
  16. multiprocessing.Pool() slower than just using ordinary functions
  17. How do you pass a Queue reference to a function managed by pool.map_async()?
  18. What kind of problems (if any) would there be combining asyncio with multiprocessing?
  19. What is the difference between multiprocessing and subprocess?
  20. Python Multiprocessing Lib Error (AttributeError: __exit__)
  21. How to do multiprocessing in FastAPI
  22. Show the progress of a Python multiprocessing pool imap_unordered call?
  23. Is it possible to multiprocess a function that returns something in Python?
  24. Easiest way to read csv files with multiprocessing in Pandas
  25. Python multiprocessing memory usage
  26. How to signal slots in a GUI from a different process?
  27. How to limit number of CPU’s used by a python script w/o terminal or multiprocessing library?
  28. Multiprocessing pool with an iterator
  29. multiprocessing: How can I ʀᴇʟɪᴀʙʟʏ redirect stdout from a child process?
  30. Sharing a lock between gunicorn workers

Leave a Comment