Maximum concurrent requests for WebClient, HttpWebRequest, and HttpClient

by

Yes, there is a limit. The default connection limit is 2 concurrent connections per remote host. This can be overridden. For example, I believe that ASP.NET by default overrides the default to be 10 connections per remote host.

From https://msdn.microsoft.com/en-us/library/7af54za5.aspx:

The number of connections between a client and server can have a
dramatic impact on application throughput. By default, an application
using the HttpWebRequest class uses a maximum of two persistent
connections to a given server, but you can set the maximum number of
connections on a per-application basis.

To change the connection limit yourself, use ServicePointManager.DefaultConnectionLimit. Make sure to make this change soon after your process starts up, before you start making HTTP connections to the remote host. This is because because once you actually make an HTTP connection to a remote host, then a ServicePoint will be created for that remote host using the current default connection limit.

Note that there are other effective limits on concurrent connections beyond what’s enforced by the HTTP client classes. For example, if you wanted to open a million concurrent connections, you’d probably run out of RAM, or threads, or some other OS resource. If you’re bumping up against those limits, then you’ll need to ask another more general question about how to scale up a .net process to process a lot of concurrent I/O. But if you’re only opening a few tens of connections then you should be fine.

BTW, if you’re curious why the default limits are so low, it’s actually baked into the HTTP specification– the goal was to ensure that selfish HTTP clients didn’t swamp HTTP servers with simultaneous connections. Although modern browsers ignore the spec. See http://www.stevesouders.com/blog/2008/03/20/roundup-on-parallel-connections/ for a lot more detail about this topic than you ever wanted to know!

More Related Contents:

  1. How can I programmatically remove the 2 connection limit in WebClient
  2. Converting Raw HTTP Request into HTTPWebRequest Object
  3. WebClient vs. HttpWebRequest/HttpWebResponse
  4. HEAD with WebClient?
  5. Upload files with HTTPWebrequest (multipart/form-data)
  6. Automatically decompress gzip response via WebClient.DownloadData
  7. .Net HttpWebRequest.GetResponse() raises exception when http status code 400 (bad request) is returned
  8. Max number of concurrent HttpWebRequests
  9. HttpWebRequest to URL with dot at the end
  10. how to use cookies with HttpWebRequest
  11. .NET: Is it possible to get HttpWebRequest to automatically decompress gzip’d responses?
  12. Get HTTP requests and responses made using HttpWebRequest/HttpWebResponse to show in Fiddler
  13. WebClient.DownloadString results in mangled characters due to encoding issues, but the browser is OK
  14. What difference is there between WebClient and HTTPWebRequest classes in .NET?
  15. HTTP POST Returns Error: 417 “Expectation Failed.”
  16. How to clear the cache of HttpWebRequest
  17. When is an HTTP response finished?
  18. Am I able to reuse a HttpWebRequest?
  19. Getting Http Status code number (200, 301, 404, etc.) from HttpWebRequest and HttpWebResponse
  20. Download file with WebClient or HttpClient?
  21. Set the SecurityProtocol (Ssl3 or TLS) on the .net HttpWebRequest per request
  22. What is the best way to read GetResponseStream()?
  23. Add Expires or Cache Control Header to static content in IIS
  24. How to post a file via HTTP post in vb.net
  25. How can I force a hard refresh (ctrl+F5)?
  26. .NET LINQ query syntax vs method chain
  27. When to use IComparable Vs. IComparer
  28. WCF service startup error “This collection already contains an address with scheme http”
  29. Passing quotes in Process.Start arguments
  30. How to control appearance of ‘:’ in time zone offset when parsing/formatting Datetime

Leave a Comment