Proxies with Python ‘Requests’ module

by

The proxies‘ dict syntax is {"protocol": "scheme://ip:port", ...}. With it you can specify different (or the same) proxie(s) for requests using http, https, and ftp protocols:

http_proxy  = "http://10.10.1.10:3128"
https_proxy = "https://10.10.1.11:1080"
ftp_proxy   = "ftp://10.10.1.10:3128"

proxies = { 
              "http"  : http_proxy, 
              "https" : https_proxy, 
              "ftp"   : ftp_proxy
            }

r = requests.get(url, headers=headers, proxies=proxies)

Deduced from the requests documentation:

Parameters:
method – method for the new Request object.
url – URL for the new Request object.
…
proxies – (optional) Dictionary mapping protocol to the URL of the proxy.
…

On linux you can also do this via the HTTP_PROXY, HTTPS_PROXY, and FTP_PROXY environment variables:

export HTTP_PROXY=10.10.1.10:3128
export HTTPS_PROXY=10.10.1.11:1080
export FTP_PROXY=10.10.1.10:3128

On Windows:

set http_proxy=10.10.1.10:3128
set https_proxy=10.10.1.11:1080
set ftp_proxy=10.10.1.10:3128

More Related Contents:

  1. Using headers with the Python requests library’s get method
  2. How to send cookies in a post request with the Python Requests library?
  3. Getting HEAD content with Python Requests
  4. how can i change from python2 http request code to python3 Requests [closed]
  5. Asynchronous Requests with Python requests
  6. What’s the best way to parse a JSON response from the requests library?
  7. How to use Python requests to fake a browser visit a.k.a and generate User Agent?
  8. Log all requests from the python-requests module
  9. Python Requests requests.exceptions.SSLError: [Errno 8] _ssl.c:504: EOF occurred in violation of protocol
  10. SSL InsecurePlatform error when using Requests package
  11. Python Requests – How to use system ca-certificates (debian/ubuntu)?
  12. Web scraping program cannot find element which I can see in the browser
  13. How do I read a response from Python Requests?
  14. Python – requests.exceptions.SSLError – dh key too small
  15. Is the Session object from Python’s Requests library thread safe?
  16. Login to Facebook using python requests
  17. Python Requests package: Handling xml response
  18. Python Requests vs PyCurl Performance
  19. zsh: no matches found: requests[security]
  20. Requests failing to connect to a TLS server
  21. python how to decode http response
  22. Using cookies.txt file with Python Requests
  23. Use python requests to download CSV
  24. Python requests library how to pass Authorization header with single token
  25. How to save requests (python) cookies to a file?
  26. how to post multiple value with same key in python requests?
  27. How to limit download rate of HTTP requests in requests python library?
  28. Progress of Python requests post
  29. Requests with multiple connections
  30. Unable to get local issuer certificate when using requests

Leave a Comment