How to avoid HTTP error 429 (Too Many Requests) python

by

Receiving a status 429 is not an error, it is the other server “kindly” asking you to please stop spamming requests. Obviously, your rate of requests has been too high and the server is not willing to accept this.

You should not seek to “dodge” this, or even try to circumvent server security settings by trying to spoof your IP, you should simply respect the server’s answer by not sending too many requests.

If everything is set up properly, you will also have received a “Retry-after” header along with the 429 response. This header specifies the number of seconds you should wait before making another call. The proper way to deal with this “problem” is to read this header and to sleep your process for that many seconds.

You can find more information on status 429 here: https://www.rfc-editor.org/rfc/rfc6585#page-3

More Related Contents:

  1. What should I do if socket.setdefaulttimeout() is not working?
  2. How to download a file over HTTP?
  3. What is the fastest way to send 100,000 HTTP requests in Python?
  4. urllib2.HTTPError: HTTP Error 403: Forbidden
  5. Unable to import a module that is definitely installed
  6. How do you send a HEAD HTTP request in Python 2?
  7. adding directory to sys.path /PYTHONPATH
  8. Problem HTTP error 403 in Python 3 Web Scraping
  9. How to add both file and JSON body in a FastAPI POST request?
  10. Python urllib2, basic HTTP authentication, and tr.im
  11. Python: HTTP Post a large file with streaming
  12. Simple URL GET/POST function in Python
  13. Only download a part of the document using python requests
  14. Python urllib2.urlopen() is slow, need a better way to read several urls
  15. How to get http headers in flask?
  16. How to stop BaseHTTPServer.serve_forever() in a BaseHTTPRequestHandler subclass?
  17. Read timeout using either urllib2 or any other http library
  18. Save a large file using the Python requests library [duplicate]
  19. Python requests speed up using keep-alive
  20. Flask – POST Error 405 Method Not Allowed
  21. How do I catch a specific HTTP error in Python?
  22. How to send zip files in the python Flask framework?
  23. Checking if a website is up via Python
  24. How to get the raw content of a response in requests with Python?
  25. Ideal method for sending multiple HTTP requests over Python? [duplicate]
  26. Is it possible to run python SimpleHTTPServer on localhost only?
  27. Django: using and POST
  28. How to limit download rate of HTTP requests in requests python library?
  29. Python requests.exception.ConnectionError: connection aborted “BadStatusLine”
  30. How to handle IncompleteRead: in python

Leave a Comment