is python capable of running on multiple cores?

by

The answer is “Yes, But…”

But cPython cannot when you are using regular threads for concurrency.

You can either use something like multiprocessing, celery or mpi4py to split the parallel work into another process;

Or you can use something like Jython or IronPython to use an alternative interpreter that doesn’t have a GIL.

A softer solution is to use libraries that don’t run afoul of the GIL for heavy CPU tasks, for instance numpy can do the heavy lifting while not retaining the GIL, so other python threads can proceed. You can also use the ctypes library in this way.

If you are not doing CPU bound work, you can ignore the GIL issue entirely (kind of) since python won’t aquire the GIL while it’s waiting for IO.

More Related Contents:

  1. Timeout on a function call
  2. Tkinter: How to use threads to preventing main event loop from “freezing”
  3. Can’t pickle when using multiprocessing Pool.map()
  4. What are the differences between the threading and multiprocessing modules?
  5. Creating Threads in python
  6. PyQt4 Wait in thread for user input from GUI
  7. Execute a function after Flask returns response
  8. Thread that I can pause and resume?
  9. python multi-threading slower than serial?
  10. Kill a running subprocess call
  11. What is “thread local storage” in Python, and why do I need it?
  12. Python threading. How do I lock a thread?
  13. why isn’t numpy.mean multithreaded?
  14. Python Threading inside a class
  15. Meaning of daemon property on Python Threads
  16. How to get the return value from a thread?
  17. Threaded Tkinter script crashes when creating the second Toplevel widget
  18. Are Generators Threadsafe?
  19. Is Keras thread safe?
  20. Using multiprocessing.Process with a maximum number of simultaneous processes
  21. How do I pass an async function to a thread target in Python?
  22. Threading in python using queue
  23. Execute Python function in Main thread from call in Dummy thread
  24. How do I create a file in python without overwriting an existing file
  25. How to implement a Lock with a timeout in Python 2.7
  26. Why does Paramiko hang if you use it while loading a module?
  27. Python: Why is threaded function slower than non thread
  28. Trigger an event when clipboard content changes
  29. FastAPI python: How to run a thread in the background?
  30. Why doesn’t a string in parentheses make a tuple with just that string? [duplicate]

Leave a Comment