When using asyncio, how do you allow all running tasks to finish before shutting down the event loop

by

You can retrieve unfinished tasks and run the loop again until they finished, then close the loop or exit your program.

pending = asyncio.all_tasks()
loop.run_until_complete(asyncio.gather(*pending))
  • pending is a list of pending tasks.
  • asyncio.gather() allows to wait on several tasks at once.

If you want to ensure all the tasks are completed inside a coroutine (maybe you have a “main” coroutine), you can do it this way, for instance:

async def do_something_periodically():
    while True:
        asyncio.create_task(my_expensive_operation())
        await asyncio.sleep(my_interval)
        if shutdown_flag_is_set:
            print("Shutting down")
            break

    await asyncio.gather(*asyncio.all_tasks())

Also, in this case, since all the tasks are created in the same coroutine, you already have access to the tasks:

async def do_something_periodically():
    tasks = []
    while True:
        tasks.append(asyncio.create_task(my_expensive_operation()))
        await asyncio.sleep(my_interval)
        if shutdown_flag_is_set:
            print("Shutting down")
            break

    await asyncio.gather(*tasks)

More Related Contents:

  1. How does asyncio actually work?
  2. Asynchronous method call in Python?
  3. How can I periodically execute a function with asyncio?
  4. Python 3.7 – asyncio.sleep() and time.sleep()
  5. multiprocessing vs multithreading vs asyncio in Python 3
  6. RuntimeError: This event loop is already running in python
  7. Asyncio.gather vs asyncio.wait
  8. Python simple socket client/server using asyncio
  9. Sharing python objects across multiple workers
  10. Timeout for python coroutines
  11. “Asyncio Event Loop is Closed” when getting loop
  12. How do I run Python asyncio code in a Jupyter notebook?
  13. Combine awaitables like Promise.all
  14. Learning asyncio: “coroutine was never awaited” warning error
  15. What kind of problems (if any) would there be combining asyncio with multiprocessing?
  16. How can I wrap a synchronous function in an async coroutine?
  17. Does asyncio supports asynchronous I/O for file operations?
  18. What does “SSLError: [SSL] PEM lib (_ssl.c:2532)” mean using the Python ssl library?
  19. asyncio.sleep() vs time.sleep() in Python
  20. asyncio: Is it possible to cancel a future been run by an Executor?
  21. Mocking async call in python 3.5
  22. multiprocessing vs multithreading vs asyncio
  23. Use asyncio and Tkinter (or another GUI lib) together without freezing the GUI
  24. asyncio.ensure_future vs. BaseEventLoop.create_task vs. simple coroutine?
  25. aiohttp: set maximum number of requests per second
  26. Prompt for user input using python asyncio.create_server instance
  27. Why am I getting NotImplementedError with async and await on Windows?
  28. “asyncio.run() cannot be called from a running event loop” when using Jupyter Notebook
  29. Exception event loop is closed with aiohttp and asyncio in python 3.8
  30. how to add a coroutine to a running asyncio loop?

Leave a Comment