How to configure concurrency in .NET Core Web API?

by

ASP.NET Core application concurrency is handled by its web server. For example:

Kestrel

var host = new WebHostBuilder()
    .UseKestrel(options => options.ThreadCount = 8)

It is not recommended to set Kestrel thread count to a large value like 1K due to Kestrel async-based implementation.

More info: Is Kestrel using a single thread for processing requests like Node.js?

New Limits property has been introduced in ASP.NET Core 2.0 Preview 2.

You can now add limits for the following:

  1. Maximum Client Connections
  2. Maximum Request Body Size
  3. Maximum Request Body Data Rate

For example:

.UseKestrel(options =>
{
    options.Limits.MaxConcurrentConnections = 100;
}

IIS

When Kestrel runs behind a reverse proxy you could tune the proxy itself. For example, you could configure IIS application pool in web.config or in aspnet.config:

<configuration>
  <system.web>
    <applicationPool
        maxConcurrentRequestsPerCPU="5000"
        maxConcurrentThreadsPerCPU="0"
        requestQueueLimit="5000" />
  </system.web>
</configuration>

Of course Nginx and Apache have their own concurrency settings.

More Related Contents:

  1. Return file in ASP.Net Core Web API
  2. SSE instructions: which CPUs can do atomic 16B memory operations?
  3. Is x86 CMPXCHG atomic, if so why does it need LOCK?
  4. What is the difference between lock, mutex and semaphore?
  5. ASP.NET Core return JSON with status code
  6. What is the Swift equivalent to Objective-C’s “@synchronized”?
  7. ASP.NET Core with IIS – HTTP Verb Not Allowed
  8. Would you explain lock ordering?
  9. How to return a specific status code and no contents from Controller?
  10. Enable OPTIONS header for CORS on .NET Core Web API
  11. What is a coroutine?
  12. Uploading and Downloading large files in ASP.NET Core 3.1?
  13. What is a memory fence?
  14. ASP.NET Core JWT mapping role claims to ClaimsIdentity
  15. How do I customize ASP.Net Core model binding errors?
  16. How does LMAX’s disruptor pattern work?
  17. Hosting ASP.NET Core API in a Windows Forms Application
  18. Using a C# 7 tuple in an ASP.NET Core Web API Controller
  19. How do goroutines work? (or: goroutines and OS threads relation)
  20. How to implement a “pure” ASP.NET Core Web API by using AddMvcCore()
  21. anonymous struct and empty struct
  22. Read request body twice
  23. Are POSIX’ read() and write() system calls atomic?
  24. What exactly does runtime.Gosched do?
  25. Visual Studio 2019 Not Showing .NET 6 Framework
  26. Is there an ExecutorService that uses the current thread?
  27. How do synchronized static methods work in Java and can I use it for loading Hibernate entities?
  28. How to deal with concurrent updates in databases?
  29. Session variable value is getting null in ASP.NET Core
  30. Duplicate ‘Content’ items were included. The .NET SDK includes ‘Content’ items from your project directory by default

Leave a Comment