Timeout for python coroutines

by

When the server closes the connection, sock_recv returns an empty bytearray (b''), indicating end of file. Since you don’t handle that condition, your code ends up stuck in an infinite loop processing the same buffer.

To correct it, add something like:

if data == b'':
    break

…after the data = await loop.sock_recv(...) line.

But the above still doesn’t explain why wait_for is unable to cancel the rogue coroutine. The problem is that await doesn’t mean “pass control to the event loop”, as it is sometimes understood. It means “request value from the provided awaitable object, yielding control to the event loop if (and as long as) the object indicates that it does not have a value ready.” The if is crucial: if the object does have a value ready when first asked, this value will be used immediately without ever deferring to the event loop. In other words, await doesn’t guarantee that the event loop will get a chance to run.

For example, the following coroutine completely blocks the event loop and prevents any other coroutine from ever running, despite its inner loop consisting of nothing but awaiting:

async def busy_loop():
    while True:
        await noop()

async def noop():
    pass

In your example, since the socket does not block at all when it is at end-of-file, the coroutine is never suspended, and (in collusion with the above bug) your coroutine never exits.

To ensure that other tasks get a chance to run, you can add await asyncio.sleep(0) in a loop. This should not be necessary for most code, where requesting IO data will soon result in a wait, at which point the event loop will kick in. (In fact, needing to do so often indicates a design flaw.) In this case it is only in combination with the EOF-handling bug that the code gets stuck.

More Related Contents:

  1. Asynchronous method call in Python?
  2. asyncio.ensure_future vs. BaseEventLoop.create_task vs. simple coroutine?
  3. How to use asyncio with threading in Python is Method threading.Timer
  4. When to use and when not to use Python 3.5 `await` ?
  5. How to limit concurrency with Python asyncio?
  6. FastAPI runs api-calls in serial instead of parallel fashion
  7. asyncio.sleep() vs time.sleep()
  8. How to combine python asyncio with threads?
  9. How can I call an async function without await?
  10. How to use asyncio with existing blocking library?
  11. asyncio CancelledError and KeyboardInterrupt
  12. How can I send an HTTP request from my FastAPI app to another site (API)?
  13. Simplest async/await example possible in Python
  14. Can an asyncio event loop run in the background without suspending the Python interpreter?
  15. How to test Python 3.4 asyncio code?
  16. How to use ‘yield’ inside async function?
  17. How to call an async function without await?
  18. Using asyncio.Queue for producer-consumer flow
  19. Python Discord.py `time.sleep()` coroutine
  20. What’s the correct way to clean up after an interrupted event loop?
  21. How to properly create and run concurrent tasks using python’s asyncio module?
  22. Why does the asyncio’s event loop suppress the KeyboardInterrupt on Windows?
  23. Is there a way to use asyncio.Queue in multiple threads?
  24. Prompt for user input using python asyncio.create_server instance
  25. Create generator that yields coroutine results as the coroutines finish
  26. How to terminate long-running computation (CPU bound task) in Python using asyncio and concurrent.futures.ProcessPoolExecutor?
  27. “asyncio.run() cannot be called from a running event loop” when using Jupyter Notebook
  28. aiohttp: rate limiting parallel requests
  29. Exception event loop is closed with aiohttp and asyncio in python 3.8
  30. Coroutine vs Continuation vs Generator

Leave a Comment