aiohttp: set maximum number of requests per second

by

Although it’s not exactly a limit on the number of requests per second, note that since v2.0, when using a ClientSession, aiohttp automatically limits the number of simultaneous connections to 100.

You can modify the limit by creating your own TCPConnector and passing it into the ClientSession. For instance, to create a client limited to 50 simultaneous requests:

import aiohttp

connector = aiohttp.TCPConnector(limit=50)
client = aiohttp.ClientSession(connector=connector)

In case it’s better suited to your use case, there is also a limit_per_host parameter (which is off by default) that you can pass to limit the number of simultaneous connections to the same “endpoint”. Per the docs:

limit_per_host (int) – limit for simultaneous connections to the same endpoint. Endpoints are the same if they are have equal (host, port, is_ssl) triple.

Example usage:

import aiohttp

connector = aiohttp.TCPConnector(limit_per_host=50)
client = aiohttp.ClientSession(connector=connector)

More Related Contents:

  1. How to combine python asyncio with threads?
  2. How can I call an async function without await?
  3. Learning asyncio: “coroutine was never awaited” warning error
  4. How can I wrap a synchronous function in an async coroutine?
  5. How to call an async function without await?
  6. aiohttp: rate limiting parallel requests
  7. Exception event loop is closed with aiohttp and asyncio in python 3.8
  8. How to use asyncio with threading in Python is Method threading.Timer
  9. When to use and when not to use Python 3.5 `await` ?
  10. How could I use requests in asyncio?
  11. How to limit concurrency with Python asyncio?
  12. asyncio.sleep() vs time.sleep()
  13. How to use asyncio with existing blocking library?
  14. asyncio CancelledError and KeyboardInterrupt
  15. Simplest async/await example possible in Python
  16. Can an asyncio event loop run in the background without suspending the Python interpreter?
  17. How do I run Python asyncio code in a Jupyter notebook?
  18. How to test Python 3.4 asyncio code?
  19. How to use ‘yield’ inside async function?
  20. asyncio: Is it possible to cancel a future been run by an Executor?
  21. Why can I only use the await keyword inside of async function?
  22. How to do multiprocessing in FastAPI
  23. How to set class attribute with await in __init__
  24. What’s the correct way to clean up after an interrupted event loop?
  25. How to properly create and run concurrent tasks using python’s asyncio module?
  26. Why does the asyncio’s event loop suppress the KeyboardInterrupt on Windows?
  27. Is there a way to use asyncio.Queue in multiple threads?
  28. Prompt for user input using python asyncio.create_server instance
  29. How to terminate long-running computation (CPU bound task) in Python using asyncio and concurrent.futures.ProcessPoolExecutor?
  30. “asyncio.run() cannot be called from a running event loop” when using Jupyter Notebook

Leave a Comment