How many concurrent requests does a single Flask process receive?

by

When running the development server – which is what you get by running app.run(), you get a single synchronous process, which means at most 1 request is being processed at a time.

By sticking Gunicorn in front of it in its default configuration and simply increasing the number of --workers, what you get is essentially a number of processes (managed by Gunicorn) that each behave like the app.run() development server. 4 workers == 4 concurrent requests. This is because Gunicorn uses its included sync worker type by default.

It is important to note that Gunicorn also includes asynchronous workers, namely eventlet and gevent (and also tornado, but that’s best used with the Tornado framework, it seems). By specifying one of these async workers with the --worker-class flag, what you get is Gunicorn managing a number of async processes, each of which managing its own concurrency. These processes don’t use threads, but instead coroutines. Basically, within each process, still only 1 thing can be happening at a time (1 thread), but objects can be ‘paused’ when they are waiting on external processes to finish (think database queries or waiting on network I/O).

This means, if you’re using one of Gunicorn’s async workers, each worker can handle many more than a single request at a time. Just how many workers is best depends on the nature of your app, its environment, the hardware it runs on, etc. More details can be found on Gunicorn’s design page and notes on how gevent works on its intro page.

More Related Contents:

  1. How can I modify Procfile to run Gunicorn process in a non-standard folder on Heroku?
  2. Flask Gunicorn app can’t get __name__ to equal ‘__main__’
  3. Debugging a Flask app running in Gunicorn
  4. How to run Flask with Gunicorn in multithreaded mode
  5. Gunicorn can’t find app when name changed from “application”
  6. How to use Flask-Script and Gunicorn
  7. Sharing a lock between gunicorn workers
  8. How to return a dict as a JSON response from a Flask view?
  9. How to get POSTed JSON in Flask?
  10. Flask raises TemplateNotFound error even though template file exists
  11. Reference template variable within Jinja expression
  12. Is the server bundled with Flask safe to use in production?
  13. How do I get Flask to run on port 80?
  14. Get raw POST body in Python Flask regardless of Content-Type header
  15. Form sending error, Flask
  16. ImportError: No Module Named bs4 (BeautifulSoup)
  17. Disabling caching in Flask [duplicate]
  18. Where should I place the secret key in Flask?
  19. RuntimeError: working outside of application context
  20. 104, ‘Connection reset by peer’ socket error, or When does closing a socket result in a RST rather than FIN?
  21. Extending Flask class as main App
  22. CSS Problems with Flask Web App
  23. Python Flask, how to set content type
  24. Flask URL Route: Route Several URLs to the same function
  25. how to get access to error message from abort command when using custom error handler
  26. Flask(‘application’) versus Flask(__name__)
  27. Unable to “import matplotlib.pyplot as plt” in virtualenv
  28. How can we call one route from another route with parameters in Flask?
  29. Return a requests.Response object from Flask
  30. Converting matplotlib png to base64 for viewing in html template

Leave a Comment