Max retries exceeded with URL in requests

by

Just use requests' features:

import requests
from requests.adapters import HTTPAdapter
from requests.packages.urllib3.util.retry import Retry


session = requests.Session()
retry = Retry(connect=3, backoff_factor=0.5)
adapter = HTTPAdapter(max_retries=retry)
session.mount('http://', adapter)
session.mount('https://', adapter)

session.get(url)

This will GET the URL and retry 3 times in case of requests.exceptions.ConnectionError. backoff_factor will help to apply delays between attempts to avoid to fail again in case of periodic request quota.

Take a look at requests.packages.urllib3.util.retry.Retry, it has many options to simplify retries.

More Related Contents:

  1. How to “log in” to a website using Python’s Requests module?
  2. Python Requests throwing SSLError
  3. Python requests – print entire http request (raw)?
  4. Python Requests library redirect new url
  5. Python requests. 403 Forbidden
  6. How could I use requests in asyncio?
  7. Python Requests – No connection adapters
  8. python requests.get() returns improperly decoded text instead of UTF-8?
  9. python ignore certificate validation urllib2
  10. Using Python Requests: Sessions, Cookies, and POST
  11. Only download a part of the document using python requests
  12. OpenSSL errors in python requests
  13. Python – Requests, Selenium – passing cookies while logging in
  14. Python : Trying to POST form using requests
  15. How to get response SSL certificate from requests in python?
  16. Send http request through specific network interface
  17. How to resume file download in Python?
  18. parsing XML file gets UnicodeEncodeError (ElementTree) / ValueError (lxml)
  19. How can I use cookies in Python Requests?
  20. Can bs4 get the dynamic content of a webpage if requests can’t?
  21. Caused by SSLError(“Can’t connect to HTTPS URL because the SSL module is not available.”
  22. Error status code 403 even with headers, Python Requests
  23. What is the difference between ‘content’ and ‘text’
  24. parse multipart/form-data, received from requests post
  25. Get html using Python requests?
  26. multipart data POST using python requests: no multipart boundary was found
  27. How to get the raw content of a response in requests with Python?
  28. How to disable cookie handling with the Python requests library?
  29. Unit testing a python app that uses the requests library
  30. Python 3: using requests does not get the full content of a web page

Leave a Comment