Go client program generates a lot a sockets in TIME_WAIT state

by

The default http.Transport is opening and closing connections too quickly. Since all connections are to the same host:port combination, you need to increase MaxIdleConnsPerHost to match your value for num_coroutines. Otherwise, the transport will frequently close the extra connections, only to have them reopened immediately.

You can set this globally on the default transport:

http.DefaultTransport.(*http.Transport).MaxIdleConnsPerHost = numCoroutines

Or when creating your own transport

t := &http.Transport{
    Proxy: http.ProxyFromEnvironment,
    DialContext: (&net.Dialer{
        Timeout:   30 * time.Second,
        KeepAlive: 30 * time.Second,
    }).DialContext,
    MaxIdleConnsPerHost:   numCoroutines,
    MaxIdleConns:          100,
    IdleConnTimeout:       90 * time.Second,
    TLSHandshakeTimeout:   10 * time.Second,
    ExpectContinueTimeout: 1 * time.Second,
}

Similar question: Go http.Get, concurrency, and “Connection reset by peer”

More Related Contents:

  1. How to idiomatically log auth information with middleware
  2. Why do I need to use http.StripPrefix to access my static files?
  3. Golang read request body multiple times [duplicate]
  4. Correct way of getting Client’s IP Addresses from http.Request
  5. Why is my Hello World go server getting crushed by ApacheBench?
  6. Process Management for the Go Webserver
  7. Setting HTTP headers
  8. How can I start the browser AFTER the server started listening?
  9. Go http.Get, concurrency, and “Connection reset by peer”
  10. How to serve http partial content with Go?
  11. Why this simple web server is called even number times?
  12. Make a URL-encoded POST request using `http.NewRequest(…)`
  13. Should a 502 HTTP status code be used if a proxy receives no response at all?
  14. Do we need to close the response object if an error occurs while calling http.Get(url)?
  15. What is the difference between POST and PUT in HTTP?
  16. How long do browsers cache HTTP 301s?
  17. Correct way to pass multiple values for same parameter name in GET request
  18. What is the difference between HTTP status code 200 (cache) vs status code 304?
  19. HTTP 1.0 vs 1.1
  20. How to set a timeout on a http.request() in Node?
  21. Cookie handling in Google Apps Script – How to send cookies in header?
  22. Difference between no-cache and must-revalidate
  23. HTTP status code for a partial successful request
  24. Escaping username characters in basic auth URLs
  25. Can I stream a file upload to S3 without a content-length header?
  26. HTTP status code for temporarily unavailable pages
  27. nginx upload client_max_body_size issue
  28. “Cannot GET /” with Connect on Node.js
  29. Is a URL with // in the path-section valid?
  30. How to set up CORS or OPTIONS for Rocket.rs

Leave a Comment