Python: concurrent.futures How to make it cancelable?

by

Unfortunately, running Futures cannot be cancelled. I believe the core reason is to ensure the same API over different implementations (it’s not possible to interrupt running threads or coroutines).

The Pebble library was designed to overcome this and other limitations.

from pebble import ProcessPool

def function(foo, bar=0):
    return foo + bar

with ProcessPool() as pool:
    future = pool.schedule(function, args=[1])

    # if running, the container process will be terminated 
    # a new process will be started consuming the next task
    future.cancel()

More Related Contents:

  1. Is having a concurrent.futures.ThreadPoolExecutor call dangerous in a FastAPI endpoint?
  2. Deadlock with logging multiprocess/multithread python script
  3. multiprocess or threading in python?
  4. Use tqdm with concurrent.futures?
  5. Python parallel execution with selenium
  6. Multiprocessing Share Unserializable Objects Between Processes
  7. Fast replacement of values in a numpy array
  8. Moving x-axis to the top of a plot in matplotlib
  9. Dummy variables when not all categories are present
  10. Is there a builtin identity function in python?
  11. Python raises SyntaxError on “=” in if statement [closed]
  12. Difference between data and json parameters in python requests package
  13. How to run multiple jobs in one Sparkcontext from separate threads in PySpark?
  14. Simplest async/await example possible in Python
  15. Check if list items contains substrings from another list
  16. Split models.py into several files
  17. python-re: How do I match an alpha character
  18. Error “(unicode error) ‘unicodeescape’ codec can’t decode bytes in position 2-3: truncated \UXXXXXXXX escape” [duplicate]
  19. How can I read large text files line by line, without loading them into memory? [duplicate]
  20. Python Sort() method [duplicate]
  21. BeautifulSoup – extracting attribute values
  22. python requests module and connection reuse
  23. Python pandas: how to remove nan and -inf values
  24. Handle notifications in Python + Selenium Chrome WebDriver
  25. How to summarize on different groupby combinations?
  26. Python and F-Strings explanation
  27. TypeError: ufunc ‘add’ did not contain a loop with signature matching types
  28. OpenCv CreateImage Function isn’t working
  29. How to read data in Google Colab from my Google drive?
  30. What is the computational complexity of `itertools.combinations` in python?

Leave a Comment