Python: Something like `map` that works on threads [closed]

by

There is a map method in multiprocessing.Pool. That does multiple processes.

And if multiple processes aren’t your dish, you can use multiprocessing.dummy which uses threads.

import urllib
import multiprocessing.dummy

p = multiprocessing.dummy.Pool(5)
def f(post):
    return urllib.urlopen('http://stackoverflow.com/questions/%u' % post)

print p.map(f, range(3329361, 3329361 + 5))

More Related Contents:

  1. What are the differences between the threading and multiprocessing modules?
  2. Make 2 functions run at the same time
  3. deciding among subprocess, multiprocessing, and thread in Python?
  4. How to run multiple functions at the same time?
  5. How to run functions in parallel?
  6. threading.Timer – repeat function every ‘n’ seconds
  7. Freezing/Hanging tkinter GUI in waiting for the thread to complete
  8. Threading in a PyQt application: Use Qt threads or Python threads?
  9. Does Python support multithreading? Can it speed up execution time?
  10. What is the use of join() in Python threading?
  11. Is there any way to kill a Thread?
  12. How to start and stop a thread
  13. A very simple multithreading parallel URL fetching (without queue)
  14. background function in Python
  15. Using the multiprocessing module for cluster computing
  16. How to iterate over consecutive chunks of Pandas dataframe efficiently
  17. threading ignores KeyboardInterrupt exception
  18. Overriding python threading.Thread.run()
  19. What kind of problems (if any) would there be combining asyncio with multiprocessing?
  20. Python Threading String Arguments
  21. Terminate multiple threads when any thread completes a task
  22. Change the connection pool size for Python’s “requests” module when in Threading
  23. Mutli-threading python with Tkinter
  24. Is there a simple process-based parallel map for python?
  25. Mapping over values in a python dictionary
  26. Return value from thread
  27. How to obtain a Thread id in Python?
  28. Dump stacktraces of all active Threads
  29. How to use QThread correctly in pyqt with moveToThread()?
  30. ‘sys.excepthook’ and threading

Leave a Comment